00000001:02000400:2.0F:1787833561.757690:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787833570.715327:0:3157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787833571.609494:0:3198:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1379 MB/s 00000001:01000000:3.0:1787833571.859634:0:3198:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1523 MB/s 00000001:01000000:3.0:1787833572.109425:0:3198:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10167 MB/s 00000020:02000000:2.0:1787833572.425454:0:3249:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_98_gaf12cc4 00000400:02000000:2.0:1787833572.792461:0:3264:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.115@tcp [8/256/0/180] 00008000:02000000:2.0:1787833577.045895:0:3414:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787833629.091855:0:5216:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1787833640.137560:0:5796:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787833640.137573:0:5796:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787833640.137695:0:5796:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ee9d44f9 00000080:02000400:1.0:1787833640.137706:0:5796:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787833640.143895:0:5796:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787833640.143911:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787833640.144051:0:5796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000968219b8) 00000020:00000080:1.0:1787833640.144075:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787833640.187658:0:5796:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787833640.190557:0:5796:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787833640.252442:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787833640.252613:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787833640.252636:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787833640.252693:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787833640.252720:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787833640.253896:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787833640.253905:0:5796:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787833640.253917:0:5796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e7749c6 00000020:01000004:2.0:1787833640.253926:0:5796:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787833640.253930:0:5796:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787833640.253936:0:5796:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ee9d44f9 from MGS 00000020:01000004:2.0:1787833640.253941:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787833640.253968:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000002d74019) 00000020:00000080:2.0:1787833640.253980:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787833640.254407:0:5796:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ee9d44f9 from MGS, refs=2 00080000:01000000:2.0:1787833640.254416:0:5796:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787833640.254421:0:5796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e7749d4 00000100:00100000:2.0:1787833640.254681:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787833640.254897:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787833640.254903:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787833640.259750:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787833640.259766:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787833640.261031:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833640.262032:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787833640.262040:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787833640.262705:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787833640.262713:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787833640.263199:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787833640.263205:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787833640.264139:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833640.264143:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833640.264145:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833640.264570:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833640.264573:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833640.264582:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833640.265407:0:5796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787833640.266886:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787833640.515956:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2195 MB/s 00000001:01000000:2.0:1787833640.766275:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2775 MB/s 00000001:01000000:0.0:1787833641.015440:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 439 MB/s 00000001:01000000:2.0:1787833641.265959:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 715 MB/s 00080000:10000000:2.0:1787833641.273899:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787833641.285999:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787833641.300282:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787833641.300298:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787833641.300301:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787833641.303568:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787833641.304263:0:5796:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787833641.304429:0:5796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787833641.305202:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787833641.305235:0:5796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787833641.306661:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833641.307971:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787833641.307980:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787833641.319692:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787833641.319706:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787833641.322539:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787833641.322553:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787833641.323247:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787833641.323270:0:5796:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.115@tcp' 00000020:01000004:0.0:1787833641.323272:0:5796:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:1.0:1787833641.323645:0:5811:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1787833641.323780:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.115@tcp (typ=mgc) 00000020:00000080:1.0:1787833641.323792:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.115@tcp (00000000ec36a294) 00000020:00000080:1.0:1787833641.323811:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787833641.323902:0:5796:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004337ccb5@MGC192.168.202.115@tcp: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787833641.324071:0:5796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.115@tcp-0 is initialized 00000040:01000000:1.0:1787833641.324078:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787833641.332940:0:5812:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787833641.332982:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.115@tcp (uuid b866019b-748d-45d1-b7c8-b21ed54e15f4) 00000020:00000080:1.0:1787833641.333006:0:5796:0:(genops.c:1385:class_connect()) connect: client b866019b-748d-45d1-b7c8-b21ed54e15f4, cookie 0x2bdb54ee5e7749e2 00000100:00080000:1.0:1787833641.333018:0:5796:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787833641.333024:0:5796:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import 000000004337ccb5 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787833641.333058:0:5796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000007a4abb5 x1874679375593600/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787833641.333081:0:5796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b866019b-748d-45d1-b7c8-b21ed54e15f4->MGS 00000020:01000004:1.0:1787833641.333098:0:5796:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787833641.333104:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787833641.333130:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ba74e8a9) 00000020:00000080:1.0:1787833641.333140:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787833641.359622:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007a4abb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b866019b-748d-45d1-b7c8-b21ed54e15f4:3279:1874679375593600:0@lo:250: 00000100:00100000:2.0:1787833641.359714:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833641.362493:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375593600 00000100:00100000:3.0:1787833641.362508:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375593600 00000100:00100000:3.0:1787833641.362566:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787833641.362574:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056721d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3279:x1874679375593600:12345-0@lo:250: 00010000:00080000:3.0:1787833641.362606:0:5807:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from b866019b-748d-45d1-b7c8-b21ed54e15f4@0@lo t0 exp 0000000000000000 cur 120 last 0 00000020:00000080:3.0:1787833641.362634:0:5807:0:(genops.c:1385:class_connect()) connect: client b866019b-748d-45d1-b7c8-b21ed54e15f4, cookie 0x2bdb54ee5e7749f0 00000100:00080000:3.0:1787833641.362946:0:5807:0:(import.c:65:import_set_state_nolock()) 0000000033ef17a1 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833641.363053:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056721d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:3279:x1874679375593600:12345-0@lo:250: Request processed in 479us (3339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833641.363062:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833641.363762:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787833641.363945:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787833641.363951:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787833641.364408:0:3279:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787833641.364419:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.115@tcp: connect to target with instance 0 00000100:00080000:3.0:1787833641.364427:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787833641.364432:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787833641.364437:0:3279:0:(import.c:65:import_set_state_nolock()) 000000004337ccb5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787833641.364440:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00100000:1.0:1787833641.364998:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787833641.365006:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787833641.365273:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787833641.365279:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787833641.370084:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00080000:3.0:1787833641.370637:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787833641.370650:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007a4abb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b866019b-748d-45d1-b7c8-b21ed54e15f4:3279:1874679375593600:0@lo:250: 00000100:00100000:1.0:1787833641.371064:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787833641.371071:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787833641.387305:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787833641.387321:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787833641.463787:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833641.463996:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787833641.464002:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787833641.465105:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787833641.465123:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787833641.466521:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833641.466746:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787833641.466752:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787833641.467671:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787833641.467680:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787833641.473778:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833641.473942:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787833641.473947:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787833641.474539:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787833641.474546:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787833641.475023:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833641.475277:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787833641.475282:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787833641.475840:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787833641.475854:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787833641.547602:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833641.547800:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787833641.547806:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787833641.564768:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787833641.564787:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787833641.569625:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787833641.569642:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787833641.576118:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787833641.576143:0:5796:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787833641.576162:0:5796:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787833641.576298:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787833641.576368:0:5796:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787833641.576373:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787833641.576375:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787833641.576376:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833641.576377:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833641.576378:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833641.576379:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833641.576380:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787833641.576381:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787833641.576383:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833641.576384:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833641.576386:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833641.576387:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833641.576389:0:5796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787833641.576392:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787833641.576393:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787833641.576394:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833641.576395:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833641.576396:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833641.576397:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833641.576398:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787833641.576399:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787833641.576400:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833641.576401:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833641.576402:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833641.576403:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833641.576430:0:5796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787833641.576448:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c724eb2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375593728:0@lo:253: 00000100:00100000:2.0:1787833641.576529:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833641.576577:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9aafacd going to sleep for 11 seconds 00000100:00100000:3.0:1787833641.576721:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375593728 00000100:00100000:3.0:1787833641.576734:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375593728 00000100:00100000:3.0:1787833641.576787:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833641.576795:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c7ede89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:5796:x1874679375593728:12345-0@lo:253: 20000000:01000000:3.0:1787833641.576841:0:5809:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787833641.576844:0:5809:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787833641.578966:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787833641.579037:0:5809:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787833641.579584:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833641.585466:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787833641.587854:0:5809:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787833641.587861:0:5809:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787833641.587868:0:5809:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787833641.587872:0:5809:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787833641.587889:0:5809:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787833641.588544:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787833641.589248:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787833641.589269:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787833641.589320:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787833641.589555:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787833641.589594:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787833641.589701:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787833641.589709:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787833641.589907:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787833641.589916:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787833641.590013:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787833641.590022:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787833641.590055:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787833641.590122:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787833641.590175:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787833641.590181:0:5809:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787833641.590196:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787833641.590912:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787833641.590927:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787833641.591504:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787833641.591558:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787833641.591608:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787833641.591621:0:5809:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787833641.592233:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787833641.592248:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787833641.592299:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787833641.592400:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787833641.592436:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787833641.592447:0:5809:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787833641.592537:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787833641.592547:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787833641.592577:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787833641.592610:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787833641.592792:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787833641.592838:0:5809:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787833641.592846:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787833641.593611:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787833641.594281:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787833641.594310:0:5809:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.115@tcp for mdt 20000000:01000000:3.0:1787833641.594312:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:3.0:1787833641.594863:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787833641.594875:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787833641.594914:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787833641.594922:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:3.0:1787833641.595030:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787833641.595042:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787833641.595075:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787833641.595111:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787833641.595201:0:5809:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787833641.595204:0:5809:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787833641.595210:0:5809:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787833641.595228:0:5809:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787833641.598962:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787833641.599138:0:5809:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787833641.613665:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787833641.613724:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1787833641.613804:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1787833641.613825:0:5809:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787833641.613829:0:5809:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787833641.613832:0:5809:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787833641.613871:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787833641.613874:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787833641.613906:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787833641.613909:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787833641.625714:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787833641.626224:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787833641.626292:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787833641.626381:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1787833641.626397:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787833641.626399:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787833641.627659:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1787833641.627986:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1787833641.628030:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1787833641.628100:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1787833641.628119:0:5809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787833641.628121:0:5809:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1787833641.628128:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787833641.628160:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628177:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628186:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628192:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628220:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628226:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628231:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005718f83 already unused, calling callback (00000000ced7095a) 00010000:00010000:0.0:1787833641.628235:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628241:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628253:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628266:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.628272:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005718f83/0x2bdb54ee5e7749f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787833641.628290:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787833641.966039:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c7ede89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:5796:x1874679375593728:12345-0@lo:253: Request processed in 389237us (389502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833641.966060:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833641.966175:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c724eb2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375593728:0@lo:253: 10000000:01000000:2.0:1787833641.966191:0:5796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787833641.966194:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787833641.966195:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787833641.966197:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833641.966197:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787833641.966198:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833641.966200:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833641.966201:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787833641.966202:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787833641.966203:0:5796:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787833641.966205:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833641.966206:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787833641.966227:0:5796:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ee9d44f9 from lustre-MDT0000 10000000:01000000:2.0:1787833641.966251:0:5796:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787833641.966253:0:5796:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787833641.966266:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b6443fdced8 10000000:01000000:2.0:1787833641.966271:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787833641.966278:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6443fdced8 from 1 10000000:01000000:2.0:1787833641.966280:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787833641.966313:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 000000000047a371/0x2bdb54ee5e7749fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.966323:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 000000000047a371/0x2bdb54ee5e7749fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.966331:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 000000000047a371/0x2bdb54ee5e7749fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833641.966380:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c724eb2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375593856:0@lo:101: 00000100:00100000:2.0:1787833641.966414:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833641.966456:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000467e88db going to sleep for 11 seconds 00000100:00100000:1.0:1787833641.966661:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375593856 00000100:00100000:1.0:1787833641.966667:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375593856 00000100:00100000:1.0:1787833641.966715:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787833641.966723:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0380b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:5796:x1874679375593856:12345-0@lo:101: 00010000:00010000:1.0:1787833641.966738:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833641.966752:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043da4939/0x2bdb54ee5e774a05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e7749fe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833641.966777:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043da4939/0x2bdb54ee5e774a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e7749fe expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833641.966786:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043da4939/0x2bdb54ee5e774a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e7749fe expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833641.966805:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043da4939, rc 0) 00000100:00100000:1.0:1787833641.966954:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0380b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+6:5796:x1874679375593856:12345-0@lo:101: Request processed in 232us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833641.966960:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833641.967583:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c724eb2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375593856:0@lo:101: 00010000:00010000:0.0:1787833641.967602:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 000000000047a371/0x2bdb54ee5e7749fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833641.967612:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 000000000047a371/0x2bdb54ee5e7749fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833641.967683:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079e4a75b pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375593984:0@lo:501: 00000100:00100000:0.0:1787833641.967720:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833641.967743:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000003ceb00f0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833641.967806:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375593984 00000100:00100000:1.0:1787833641.967811:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375593984 00000100:00100000:1.0:1787833641.967843:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833641.967849:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000270c2383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+6:5796:x1874679375593984:12345-0@lo:501: 00000100:00100000:1.0:1787833641.968078:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000270c2383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+6:5796:x1874679375593984:12345-0@lo:501: Request processed in 229us (358us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787833641.968085:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833641.968221:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079e4a75b pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375593984:0@lo:501: 10000000:01000000:2.0:1787833641.968252:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787833641.968277:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 000000000047a371/0x2bdb54ee5e7749fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.968286:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 000000000047a371/0x2bdb54ee5e7749fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833641.968294:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6460630000 10000000:01000000:2.0:1787833641.968299:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787833641.968303:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b6460630000 10000000:01000000:2.0:1787833641.968306:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787833641.968308:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b6460630000 from 1 10000000:01000000:2.0:1787833641.968311:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787833641.968331:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 0000000043bf228f/0x2bdb54ee5e774a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.968337:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 0000000043bf228f/0x2bdb54ee5e774a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.968368:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 0000000043bf228f/0x2bdb54ee5e774a0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833641.968381:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d7cb033 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594112:0@lo:101: 00000100:00100000:2.0:1787833641.968410:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833641.968431:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac80a0fe going to sleep for 11 seconds 00000100:00100000:2.0:1787833641.968449:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375594112 00000100:00100000:2.0:1787833641.968453:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375594112 00000100:00100000:2.0:1787833641.968818:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833641.968828:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085ef4164 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+6:5796:x1874679375594112:12345-0@lo:101: 00010000:00010000:2.0:1787833641.968847:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833641.968860:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000183508dc/0x2bdb54ee5e774a13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774a0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.968877:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000183508dc/0x2bdb54ee5e774a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a0c expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.968887:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000183508dc/0x2bdb54ee5e774a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a0c expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.968894:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000183508dc, rc 0) 00000100:00100000:2.0:1787833641.968933:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085ef4164 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+7:5796:x1874679375594112:12345-0@lo:101: Request processed in 108us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833641.968939:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833641.969015:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d7cb033 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594112:0@lo:101: 00010000:00010000:3.0:1787833641.969028:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 0000000043bf228f/0x2bdb54ee5e774a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833641.969034:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 0000000043bf228f/0x2bdb54ee5e774a0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833641.969049:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787833641.969061:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 0000000043bf228f/0x2bdb54ee5e774a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833641.969067:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 0000000043bf228f/0x2bdb54ee5e774a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833641.969078:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787833641.969082:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787833641.969086:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b6460630000 10000000:01000000:3.0:1787833641.969088:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787833641.969090:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787833641.969091:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787833641.969118:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 0000000024dce39b/0x2bdb54ee5e774a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833641.969124:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 0000000024dce39b/0x2bdb54ee5e774a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833641.969129:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 0000000024dce39b/0x2bdb54ee5e774a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833641.969140:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594240:0@lo:101: 00000100:00100000:3.0:1787833641.969180:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833641.969193:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d54b173b going to sleep for 11 seconds 00000100:00100000:2.0:1787833641.969367:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375594240 00000100:00100000:2.0:1787833641.969373:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375594240 00000100:00100000:2.0:1787833641.969393:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787833641.969398:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d64acd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+7:5796:x1874679375594240:12345-0@lo:101: 00010000:00010000:2.0:1787833641.969405:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833641.969412:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001b47332b/0x2bdb54ee5e774a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774a1a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.969424:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b47332b/0x2bdb54ee5e774a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a1a expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.969431:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001b47332b/0x2bdb54ee5e774a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a1a expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833641.969436:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001b47332b, rc 0) 00000100:00100000:2.0:1787833641.969477:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d64acd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+8:5796:x1874679375594240:12345-0@lo:101: Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833641.969484:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833641.969550:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594240:0@lo:101: 00010000:00010000:3.0:1787833641.969559:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 0000000024dce39b/0x2bdb54ee5e774a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833641.969565:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 0000000024dce39b/0x2bdb54ee5e774a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833641.969606:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594368:0@lo:501: 00000100:00100000:3.0:1787833641.969627:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833641.969659:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d54b173b going to sleep for 11 seconds 00000100:00100000:1.0:1787833641.969713:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375594368 00000100:00100000:1.0:1787833641.969717:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375594368 00000100:00100000:1.0:1787833641.969733:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787833641.969737:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000482b69f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+8:5796:x1874679375594368:12345-0@lo:501: 00000100:00100000:1.0:1787833641.970000:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000482b69f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:5796:x1874679375594368:12345-0@lo:501: Request processed in 262us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833641.970007:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787833641.970683:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594368:0@lo:501: 00000100:00100000:3.0:1787833641.970720:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594496:0@lo:503: 00000100:00100000:3.0:1787833641.970763:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833641.970795:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d54b173b going to sleep for 11 seconds 00000100:00100000:1.0:1787833641.970886:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375594496 00000100:00100000:1.0:1787833641.970890:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375594496 00000100:00100000:1.0:1787833641.970926:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787833641.970931:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ff78a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:5796:x1874679375594496:12345-0@lo:503: 00000100:00100000:1.0:1787833641.971082:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ff78a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:5796:x1874679375594496:12345-0@lo:503: Request processed in 151us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833641.971089:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787833641.971327:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594496:0@lo:503: 00000100:00100000:3.0:1787833641.973941:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:5839:1874679375594624:0@lo:502: 00000100:00100000:3.0:1787833641.974032:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833641.974076:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3e59060 going to sleep for 11 seconds 00000100:00100000:0.0:1787833641.974212:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375594624 00000100:00100000:0.0:1787833641.974218:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375594624 00000100:00100000:0.0:1787833641.974285:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787833641.974292:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000092cc51a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:5839:x1874679375594624:12345-0@lo:502: 00000100:00100000:0.0:1787833641.974526:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000092cc51a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:5839:x1874679375594624:12345-0@lo:502: Request processed in 234us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833641.974533:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787833641.974714:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:5839:1874679375594624:0@lo:502: 00000020:01000000:3.0:1787833641.974740:0:5839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833641.974751:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833641.974754:0:5839:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787833641.974758:0:5839:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787833641.974761:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833641.974778:0:5839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000059b2e498) 00000020:00000080:3.0:1787833641.974794:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787833641.974799:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787833641.974906:0:5839:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787833641.974913:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e774a2f 00000020:00000080:3.0:1787833641.975131:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787833641.975134:0:5839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833641.975137:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833641.975138:0:5839:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787833641.975140:0:5839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833641.975143:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833641.975151:0:5839:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787833641.975155:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833641.975161:0:5839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003d8a03ad) 00000020:00000080:3.0:1787833641.975173:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787833641.975177:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787833641.975178:0:5839:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787833641.975180:0:5839:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787833641.975186:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787833641.975225:0:5839:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ee9d44f9 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787833641.975234:0:5839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d8c3bf8b) 00000020:00000080:3.0:1787833641.975240:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787833641.975417:0:5839:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787833641.975423:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e774a44 00000020:00000080:3.0:1787833641.975523:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787833641.975528:0:5839:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787833641.975532:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2bdb54ee5e774a4b 00080000:01000000:3.0:1787833641.975536:0:5839:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787833641.975540:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e774a52 00080000:10000000:3.0:1787833641.975883:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787833641.976065:0:5839:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787833641.979744:0:5839:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787833642.086066:0:5839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787833642.087874:0:5839:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787833642.096134:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787833642.096485:0:5839:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787833642.187956:0:5839:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000cc4d3df) 00000020:00000080:3.0:1787833642.187982:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787833642.188037:0:5839:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787833642.188044:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e774a60 00000020:00000080:2.0:1787833642.195468:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787833642.196738:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787833642.247420:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:2.0:1787833642.300685:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787833642.315636:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787833642.411918:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833642.508710:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833642.575321:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787833642.653524:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2bdb54ee5e774a67 00000020:00000080:3.0:1787833642.668925:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787833642.668939:0:5839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833642.669108:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833642.669112:0:5839:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787833642.669117:0:5839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833642.669126:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833642.669127:0:5839:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787833642.669132:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787833642.669198:0:5839:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787833642.669217:0:5839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833642.669220:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833642.669221:0:5839:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787833642.669224:0:5839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833642.669227:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833642.669228:0:5839:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787833642.669231:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787833642.669233:0:5839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787833642.669276:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000922eadee pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:5839:1874679375594752:0@lo:502: 00000100:00100000:2.0:1787833642.669400:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833642.669463:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e44d528 going to sleep for 11 seconds 00000100:00100000:3.0:1787833642.669630:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375594752 00000100:00100000:3.0:1787833642.669643:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375594752 00000100:00100000:3.0:1787833642.669693:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833642.669702:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f1efcf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:5839:x1874679375594752:12345-0@lo:502: 00000100:00100000:3.0:1787833642.670329:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f1efcf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:5839:x1874679375594752:12345-0@lo:502: Request processed in 627us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833642.670337:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787833642.671618:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000922eadee pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:5839:1874679375594752:0@lo:502: 00000020:01000000:2.0:1787833642.671663:0:5839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833642.671671:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833642.671683:0:5839:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787833642.671688:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787833642.673200:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787833642.673228:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787833642.673246:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 0000000024dce39b/0x2bdb54ee5e774a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833642.673259:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 0000000024dce39b/0x2bdb54ee5e774a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833642.673267:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6460630000 from 1 10000000:01000000:3.0:1787833642.673269:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787833642.673304:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833642.673311:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833642.673320:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833642.673721:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594880:0@lo:101: 00000100:00100000:3.0:1787833642.673811:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833642.673894:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef3cfed9 going to sleep for 11 seconds 00000100:00100000:0.0:1787833642.690520:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375594880 00000100:00100000:0.0:1787833642.690539:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375594880 00000100:00100000:0.0:1787833642.690606:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787833642.690615:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046806b75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:5796:x1874679375594880:12345-0@lo:101: 00010000:00010000:0.0:1787833642.690633:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833642.690653:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774a6e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833642.690682:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a6e expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833642.690705:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a6e expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833642.690714:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005718f83, rc 0) 00000100:00100000:0.0:1787833642.690805:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046806b75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:5796:x1874679375594880:12345-0@lo:101: Request processed in 191us (16996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833642.690827:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787833642.690927:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aae11a96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375594880:0@lo:101: 00010000:00010000:3.0:1787833642.690951:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833642.690959:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833642.691805:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000292b5a94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595008:0@lo:256: 00000100:00100000:0.0:1787833642.691869:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833642.691924:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac19bb0c going to sleep for 11 seconds 00000100:00100000:3.0:1787833642.691980:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375595008 00000100:00100000:3.0:1787833642.691987:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375595008 00000100:00100000:3.0:1787833642.692023:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787833642.692029:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f028be73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:5796:x1874679375595008:12345-0@lo:256: 20000000:01000000:3.0:1787833642.692043:0:5807:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787833642.692048:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787833642.692132:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f028be73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:5796:x1874679375595008:12345-0@lo:256: Request processed in 103us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833642.692148:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833642.692169:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000292b5a94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595008:0@lo:256: 10000000:01000000:2.0:1787833642.692855:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787833642.692885:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.692896:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833642.692906:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6460630000 from 1 10000000:01000000:2.0:1787833642.692909:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787833642.692938:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.692945:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.692953:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833642.692969:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000922eadee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595136:0@lo:101: 00000100:00100000:2.0:1787833642.693009:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833642.693033:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e44d528 going to sleep for 11 seconds 00000100:00100000:1.0:1787833642.693985:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375595136 00000100:00100000:1.0:1787833642.694012:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375595136 00000100:00100000:1.0:1787833642.694074:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787833642.694084:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071852995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:5796:x1874679375595136:12345-0@lo:101: 00010000:00010000:1.0:1787833642.694097:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833642.694111:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774a7c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.694134:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a7c expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.694153:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a7c expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.694161:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9e33188, rc 0) 00000100:00100000:1.0:1787833642.694207:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071852995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:5796:x1874679375595136:12345-0@lo:101: Request processed in 125us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833642.694213:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833642.696502:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000922eadee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595136:0@lo:101: 00010000:00010000:2.0:1787833642.696533:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.696546:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833642.696655:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000922eadee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595264:0@lo:501: 00000100:00100000:2.0:1787833642.696725:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833642.696777:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e44d528 going to sleep for 11 seconds 00000100:00100000:2.0:1787833642.696802:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375595264 00000100:00100000:2.0:1787833642.696808:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375595264 00000100:00100000:2.0:1787833642.696853:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833642.696862:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8737b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:5796:x1874679375595264:12345-0@lo:501: 00000100:00100000:2.0:1787833642.697739:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8737b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:5796:x1874679375595264:12345-0@lo:501: Request processed in 875us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833642.697748:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787833642.698042:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000922eadee pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595264:0@lo:501: 00000100:00100000:0.0:1787833642.698085:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595392:0@lo:503: 00000100:00100000:0.0:1787833642.698150:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833642.698181:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a2f29bd going to sleep for 11 seconds 00000100:00100000:3.0:1787833642.698326:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375595392 00000100:00100000:3.0:1787833642.698333:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375595392 00000100:00100000:3.0:1787833642.698397:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787833642.698404:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000daede04c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:5796:x1874679375595392:12345-0@lo:503: 00000040:00080000:3.0:1787833642.698443:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787833642.698487:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000daede04c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:5796:x1874679375595392:12345-0@lo:503: Request processed in 84us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833642.698493:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787833642.698636:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595392:0@lo:503: 00000040:00080000:2.0:1787833642.699874:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787833642.700247:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787833642.700270:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787833642.700292:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833642.700305:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833642.700393:0:5796:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787833642.700397:0:5796:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6460630000 10000000:01000000:0.0:1787833642.700400:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6460630000 10000000:01000000:0.0:1787833642.700403:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787833642.700409:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6460630000 from 1 10000000:01000000:0.0:1787833642.700412:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787833642.700446:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000921cf608/0x2bdb54ee5e774a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833642.700453:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000921cf608/0x2bdb54ee5e774a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833642.700476:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000921cf608/0x2bdb54ee5e774a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833642.700499:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595520:0@lo:101: 00000100:00100000:0.0:1787833642.700576:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833642.700619:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb71c0b0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833642.700705:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375595520 00000100:00100000:2.0:1787833642.700712:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375595520 00000100:00100000:2.0:1787833642.700749:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787833642.700757:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000888e5d2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:5796:x1874679375595520:12345-0@lo:101: 00010000:00010000:2.0:1787833642.700769:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833642.700780:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aee41155/0x2bdb54ee5e774a91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774a8a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.700801:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aee41155/0x2bdb54ee5e774a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a8a expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.700810:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aee41155/0x2bdb54ee5e774a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a8a expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.700818:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aee41155, rc 0) 00000100:00100000:2.0:1787833642.700863:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000888e5d2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5796:x1874679375595520:12345-0@lo:101: Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833642.700876:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787833642.701411:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595520:0@lo:101: 00010000:00010000:0.0:1787833642.701427:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000921cf608/0x2bdb54ee5e774a8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833642.701436:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000921cf608/0x2bdb54ee5e774a8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833642.701485:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595648:0@lo:501: 00000100:00100000:0.0:1787833642.701513:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833642.701544:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb71c0b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833642.701602:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375595648 00000100:00100000:1.0:1787833642.701607:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375595648 00000100:00100000:1.0:1787833642.701641:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787833642.701647:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027b7242b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5796:x1874679375595648:12345-0@lo:501: 00000100:00100000:1.0:1787833642.701887:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027b7242b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5796:x1874679375595648:12345-0@lo:501: Request processed in 241us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833642.701895:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787833642.701967:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595648:0@lo:501: 00000100:00100000:0.0:1787833642.702002:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595776:0@lo:503: 00000100:00100000:0.0:1787833642.702047:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833642.702066:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb71c0b0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833642.702156:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375595776 00000100:00100000:2.0:1787833642.702161:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375595776 00000100:00100000:2.0:1787833642.702192:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787833642.702198:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb2fba0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5796:x1874679375595776:12345-0@lo:503: 00000100:00100000:2.0:1787833642.702606:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb2fba0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5796:x1874679375595776:12345-0@lo:503: Request processed in 407us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833642.702614:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787833642.702638:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375595776:0@lo:503: 00000100:00100000:0.0:1787833642.703420:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:5844:1874679375595904:0@lo:502: 00000100:00100000:0.0:1787833642.703472:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833642.703508:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e878995a going to sleep for 11 seconds 00000100:00100000:3.0:1787833642.703603:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375595904 00000100:00100000:3.0:1787833642.703611:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375595904 00000100:00100000:3.0:1787833642.703655:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787833642.703663:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c04915e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5844:x1874679375595904:12345-0@lo:502: 00000100:00100000:3.0:1787833642.703914:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c04915e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5844:x1874679375595904:12345-0@lo:502: Request processed in 252us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833642.703929:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787833642.704228:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:5844:1874679375595904:0@lo:502: 00000020:01000004:0.0:1787833642.704293:0:5844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787833642.704315:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d3d5e3c5) 00000020:00000080:0.0:1787833642.704391:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787833642.704521:0:5844:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ee9d44f9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787833642.704525:0:5844:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ee9d44f9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787833642.704527:0:5844:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ee9d44f9 4 00010000:00080000:0.0:1787833642.704552:0:5844:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000050a2dd49@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:0.0:1787833642.707406:0:5844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787833642.707610:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787833642.707642:0:5844:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787833642.707654:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2bdb54ee5e774a9f 00000100:00080000:0.0:1787833642.707665:0:5844:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787833642.707669:0:5844:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000050a2dd49 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787833642.707705:0:5844:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dd4e04ac x1874679375596032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833642.707773:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375596032:0@lo:38: 00000100:00100000:3.0:1787833642.707852:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833642.707968:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375596032 00000100:00100000:1.0:1787833642.707985:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375596032 00000100:00100000:1.0:1787833642.708033:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833642.708039:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aae11a96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1874679375596032:12345-0@lo:38: 00000100:00080000:0.0:1787833642.708168:0:5844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787833642.713395:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aae11a96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1874679375596032:12345-0@lo:38: Request processed in 5346us (5534us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787833642.713416:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833642.716827:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4eaa615 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:5844:1874679375596160:0@lo:502: 00000100:00100000:1.0:1787833642.716930:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833642.716980:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019dec6cb going to sleep for 11 seconds 00000100:00100000:2.0:1787833642.717179:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375596160 00000100:00100000:2.0:1787833642.717187:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375596160 00000100:00100000:2.0:1787833642.717418:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787833642.717429:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5844:x1874679375596160:12345-0@lo:502: 00000100:00100000:2.0:1787833642.717669:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5844:x1874679375596160:12345-0@lo:502: Request processed in 243us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833642.717678:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787833642.717798:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4eaa615 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:5844:1874679375596160:0@lo:502: 00000040:00080000:2.0:1787833642.717829:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787833642.717879:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787833642.717899:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787833642.717913:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 00000000921cf608/0x2bdb54ee5e774a8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.717924:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 00000000921cf608/0x2bdb54ee5e774a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787833642.717966:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787833642.717968:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787833642.717974:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833642.717975:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833642.717976:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833642.717977:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833642.717978:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787833642.717979:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787833642.717981:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833642.717982:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833642.717983:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833642.717984:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787833642.717988:0:5796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787833642.717990:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787833642.717991:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787833642.717993:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833642.717993:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833642.717994:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833642.717995:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833642.717996:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787833642.717997:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787833642.717998:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833642.717999:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833642.718000:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833642.718001:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787833642.718030:0:5796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787833642.718040:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000166a389 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375596288:0@lo:253: 00000100:00100000:2.0:1787833642.719186:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833642.719299:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787833642.719307:0:3279:0:(import.c:65:import_set_state_nolock()) 0000000050a2dd49 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833642.719312:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787833642.719315:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd4e04ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375596032:0@lo:38: 00000100:00100000:2.0:1787833642.719430:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000500849f0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833642.720380:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375596288 00000100:00100000:1.0:1787833642.720390:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375596288 00000100:00100000:1.0:1787833642.720440:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787833642.720448:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c40cb568 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5796:x1874679375596288:12345-0@lo:253: 20000000:01000000:1.0:1787833642.720497:0:5810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787833642.720510:0:5810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787833642.785290:0:5810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787833642.785311:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787833642.785441:0:5831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787833642.785447:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787833642.785487:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.785507:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a6e expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.785515:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.785568:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774a6e expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833642.785583:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a6e expref: 12 pid: 5809 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833642.785598:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000922eadee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874679375596416:0@lo:104: 00000100:00100000:2.0:1787833642.785665:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833642.785804:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375596416 00000100:00100000:1.0:1787833642.785812:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375596416 00000100:00100000:1.0:1787833642.785860:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833642.785868:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d7cb033 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5831:x1874679375596416:12345-0@lo:104: 00010000:00010000:1.0:1787833642.785879:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.785925:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833642.785930:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d7cb033 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5831:x1874679375596416:12345-0@lo:104: Request processed in 64us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833642.785936:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787833642.785957:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833642.785962:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.785969:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f7931a91 already unused, calling callback (00000000056c6c9e) 10000000:00010000:1.0:1787833642.785979:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.785988:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833642.785994:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833642.785999:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833642.786037:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.786045:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833642.786061:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.786067:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: 00000000f7931a91/0x2bdb54ee5e774a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a75 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.786085:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833642.786087:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833642.786088:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833642.786169:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f493dfd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375596544:0@lo:103: 00000100:00100000:1.0:1787833642.786198:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833642.786431:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9b52e0c going to sleep for 11 seconds 00000100:00100000:2.0:1787833642.786457:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000922eadee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874679375596416:0@lo:104: 00010000:00010000:2.0:1787833642.786474:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833642.787540:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375596544 00000100:00100000:1.0:1787833642.787552:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375596544 00010000:00010000:1.0:1787833642.787583:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a6e expref: 13 pid: 5809 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833642.787617:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833642.787636:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9314cc8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:3281:x1874679375596544:12345-0@lo:103: 00010000:00010000:1.0:1787833642.787650:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833642.787654:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a6e expref: 13 pid: 5809 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787664:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a6e expref: 13 pid: 5809 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787679:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005718f83/0x2bdb54ee5e774a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774a6e expref: 13 pid: 5809 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787692:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787699:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787833642.787712:0:5800:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002266337s 00010000:00010000:1.0:1787833642.787715:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787721:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787726:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787731:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787736:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000015accb1 already unused, calling callback (00000000ced7095a) 00010000:00010000:1.0:1787833642.787743:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787749:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787762:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833642.787771:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833642.787825:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9314cc8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3281:x1874679375596544:12345-0@lo:103: Request processed in 190us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833642.787832:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833642.787864:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f493dfd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375596544:0@lo:103: 00010000:00010000:0.0:1787833642.789623:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833642.789643:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833642.789650:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000015accb1/0x2bdb54ee5e774aa6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833642.793673:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c40cb568 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:5796:x1874679375596288:12345-0@lo:253: Request processed in 73218us (74484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833642.793690:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787833642.793777:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000166a389 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:5796:1874679375596288:0@lo:253: 10000000:01000000:2.0:1787833642.793794:0:5796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787833642.793797:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787833642.793799:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787833642.793800:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833642.793801:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833642.793802:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833642.793803:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833642.793804:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787833642.793806:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787833642.793807:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833642.793808:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833642.793810:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833642.793811:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787833642.793828:0:5796:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787833642.800735:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787833642.801117:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787833642.801371:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787833642.801566:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787833642.801775:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787833642.801926:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833642.803846:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833642.804190:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833642.804451:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833642.804598:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833642.804783:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833642.804941:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787833642.892267:0:5796:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787833642.980517:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787833642.980865:0:5850:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787833642.983058:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787833642.983229:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787833642.983639:0:5796:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787833642.983645:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787833642.983752:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787833642.990258:0:5849:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787833642.990267:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1787833642.998597:0:5796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787833642.999535:0:5796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787833642.999581:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787833643.000121:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787833643.000503:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787833643.001784:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787833643.001941:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787833643.002080:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787833643.003618:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787833643.003787:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787833643.003924:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787833643.004279:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787833643.004450:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787833643.004578:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787833643.004728:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787833643.004857:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787833643.005007:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787833643.005471:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787833643.005621:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787833643.005764:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787833643.005912:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787833643.006472:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787833643.006640:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787833643.006797:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787833643.006953:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787833643.007337:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787833643.007503:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787833643.007630:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787833643.007755:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787833643.007869:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787833643.008008:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787833643.008403:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787833643.008597:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787833643.008731:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787833643.008881:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787833643.009009:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787833643.009393:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787833643.010243:0:5796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787833643.072886:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787833643.152332:0:5796:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787833643.152401:0:5796:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc19741d83988 00100000:10000000:0.0:1787833643.152409:0:5796:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787833643.153035:0:5796:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787833643.153051:0:5796:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787833643.153065:0:5796:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1787833643.153110:0:5796:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787833643.196948:0:5850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787833643.197027:0:5850:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1787833643.197031:0:5850:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787833643.325302:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833644.350474:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833645.375794:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833646.397024:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833647.429753:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787833647.676616:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787833647.676624:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6460630000 from 3 10000000:01000000:1.0:1787833647.676630:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787833647.676679:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 0000000030768d33/0x2bdb54ee5e774aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833647.676691:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 0000000030768d33/0x2bdb54ee5e774aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833647.676701:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 0000000030768d33/0x2bdb54ee5e774aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833647.676727:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d347439 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375596672:0@lo:101: 00000100:00100000:1.0:1787833647.676808:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833647.676860:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c1c672d going to sleep for 11 seconds 00000100:00100000:3.0:1787833647.676948:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375596672 00000100:00100000:3.0:1787833647.676957:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375596672 00000100:00100000:3.0:1787833647.677016:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787833647.677024:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000caee09e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:5812:x1874679375596672:12345-0@lo:101: 00010000:00010000:3.0:1787833647.677037:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833647.677051:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b2901ed/0x2bdb54ee5e774ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774aad expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833647.677086:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b2901ed/0x2bdb54ee5e774ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774aad expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833647.678875:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b2901ed/0x2bdb54ee5e774ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774aad expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833647.678898:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b2901ed, rc 0) 00000100:00100000:3.0:1787833647.678982:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000caee09e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5812:x1874679375596672:12345-0@lo:101: Request processed in 1958us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833647.678991:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787833647.679917:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d347439 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375596672:0@lo:101: 00010000:00010000:2.0:1787833647.679940:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 0000000030768d33/0x2bdb54ee5e774aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833647.679951:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 0000000030768d33/0x2bdb54ee5e774aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833647.680015:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000166a389 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375596800:0@lo:256: 00000100:00100000:2.0:1787833647.680056:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833647.680086:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070f5d876 going to sleep for 11 seconds 00000100:00100000:2.0:1787833647.680117:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375596800 00000100:00100000:2.0:1787833647.680123:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375596800 00000100:00100000:2.0:1787833647.680159:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833647.680166:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000274d4930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5812:x1874679375596800:12345-0@lo:256: 20000000:01000000:2.0:1787833647.680183:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787833647.680197:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787833647.680201:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787833647.680275:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000274d4930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5812:x1874679375596800:12345-0@lo:256: Request processed in 109us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833647.680282:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833647.680314:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000166a389 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375596800:0@lo:256: 10000000:01000000:2.0:1787833647.680376:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787833647.680382:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 0000000030768d33/0x2bdb54ee5e774aad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833647.680390:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 0000000030768d33/0x2bdb54ee5e774aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787833648.192059:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787833648.192069:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787833648.192072:0:38:0:(import.c:65:import_set_state_nolock()) 0000000050a2dd49 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787833648.192084:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000050a2dd49 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787833648.192127:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ba5f409 x1874679375596928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787833648.192328:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba5f409 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375596928:0@lo:38: 00000100:00100000:0.0:1787833648.192418:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833648.192526:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375596928 00000100:00100000:3.0:1787833648.192533:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375596928 00000100:00100000:3.0:1787833648.192659:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833648.192667:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000114bc53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1874679375596928:12345-0@lo:38: 00010000:00080000:3.0:1787833648.192706:0:5817:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 126 last 0 00000020:00000080:3.0:1787833648.192738:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2bdb54ee5e774abb 00000004:00100000:3.0:1787833648.192781:0:5817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787833648.192892:0:5817:0:(import.c:65:import_set_state_nolock()) 000000002febd6cf : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833648.192946:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000114bc53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874679375596928:12345-0@lo:38: Request processed in 279us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833648.193160:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787833648.193201:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002ba5f409 x1874679375596928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787833648.193214:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787833648.193231:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787833648.193235:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787833648.193237:0:3279:0:(import.c:65:import_set_state_nolock()) 0000000050a2dd49 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787833648.193242:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba5f409 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375596928:0@lo:38: 00000001:02000400:0.0:1787833648.353001:0:6093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787833648.449433:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833649.471821:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833650.492491:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833651.529284:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833652.548580:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833653.322595:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba5f409 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375597184:0@lo:400: 00000100:00100000:3.0:1787833653.322676:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833653.322961:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375597184 00000100:00100000:1.0:1787833653.322971:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375597184 00000100:00100000:1.0:1787833653.323023:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833653.323030:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086f28752 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375597184:12345-0@lo:400: 00000100:00100000:1.0:1787833653.323097:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086f28752 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375597184:12345-0@lo:400: Request processed in 67us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833653.323105:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833653.323452:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe5fdc7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375597056:0@lo:400: 00000100:00100000:1.0:1787833653.323486:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787833653.337957:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002ba5f409 x1874679375597184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833653.337978:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba5f409 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375597184:0@lo:400: 00000100:00100000:3.0:1787833653.338036:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375597056 00000100:00100000:3.0:1787833653.338042:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375597056 00000100:00100000:3.0:1787833653.338114:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787833653.338122:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f040d56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3282:x1874679375597056:12345-0@lo:400: 00000100:00100000:3.0:1787833653.338216:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f040d56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3282:x1874679375597056:12345-0@lo:400: Request processed in 95us (14730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833653.338224:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787833653.338269:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe5fdc7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375597056:0@lo:400: 00010000:00010000:1.0:1787833653.564685:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787833653.803529:0:6295:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd098a230 20000000:00000080:1.0:1787833653.803549:0:6295:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6443fa1800 uarg=0000000000000000 20000000:01000000:1.0:1787833653.803589:0:6295:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787833653.803611:0:6295:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787833653.803616:0:6295:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787833653.804980:0:6295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787833653.804994:0:6295:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787833653.811780:0:6295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833653.812092:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787833653.812151:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787833653.812202:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787833653.812222:0:6295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787833653.812240:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833653.812258:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a7c expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833653.812266:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833653.812316:0:6295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774a7c expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833653.812332:0:6295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a7c expref: 11 pid: 5810 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833653.814006:0:6295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fa49c4e5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6295:1874679375597312:0@lo:104: 00000100:00100000:1.0:1787833653.814098:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833653.814162:0:6295:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f843db70 going to sleep for 11 seconds 00000100:00100000:3.0:1787833653.814967:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375597312 00000100:00100000:3.0:1787833653.814980:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375597312 00000100:00100000:3.0:1787833653.815051:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833653.815061:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000833f0366 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:6295:x1874679375597312:12345-0@lo:104: 00010000:00010000:3.0:1787833653.815082:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815176:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787833653.815196:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000833f0366 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:6295:x1874679375597312:12345-0@lo:104: Request processed in 137us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833653.815204:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787833653.815230:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833653.815235:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815243:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002b6caa85 already unused, calling callback (00000000056c6c9e) 10000000:00010000:3.0:1787833653.815247:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815254:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833653.815260:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833653.815267:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787833653.815314:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815321:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833653.815366:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815373:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: 000000002b6caa85/0x2bdb54ee5e774a7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815393:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833653.815395:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833653.815396:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787833653.815413:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833653.815416:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6460630000 from 1 10000000:01000000:3.0:1787833653.815420:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833653.815443:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815450:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815458:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833653.815474:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d569a4ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375597568:0@lo:101: 00000100:00100000:3.0:1787833653.815510:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833653.815538:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac19bb0c going to sleep for 11 seconds 00000100:00100000:3.0:1787833653.815553:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba5f409 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375597440:0@lo:103: 00000100:00100000:3.0:1787833653.815580:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833653.815619:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375597568 00000100:00100000:3.0:1787833653.815624:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375597568 00000100:00100000:3.0:1787833653.815654:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787833653.815660:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009db39834 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5812:x1874679375597568:12345-0@lo:101: 00010000:00010000:3.0:1787833653.815672:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833653.815683:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012ec4573/0x2bdb54ee5e774ad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774ac9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815701:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815723:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000012ec4573/0x2bdb54ee5e774ad0 lrc: 4/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815746:0:5809:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815757:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012ec4573/0x2bdb54ee5e774ad0 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815765:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012ec4573, rc 0) 00000100:00100000:3.0:1787833653.815797:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009db39834 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375597568:12345-0@lo:101: Request processed in 138us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833653.815803:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787833653.815836:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375597440 00000100:00100000:3.0:1787833653.815841:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375597440 00010000:00010000:3.0:1787833653.815856:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a7c expref: 13 pid: 5810 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833653.815880:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833653.815886:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079d7119f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:3280:x1874679375597440:12345-0@lo:103: 00010000:00010000:3.0:1787833653.815894:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833653.815898:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a7c expref: 13 pid: 5810 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815907:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a7c expref: 13 pid: 5810 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815920:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815927:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815946:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815952:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815957:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815963:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815968:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004ca95a34 already unused, calling callback (00000000ced7095a) 00010000:00010000:3.0:1787833653.815970:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815977:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815985:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000012ec4573/0x2bdb54ee5e774ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.815991:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012ec4573/0x2bdb54ee5e774ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.816010:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 0000000012ec4573/0x2bdb54ee5e774ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833653.816019:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032fa2951 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5800:1874679375597696:0@lo:105: 00000100:00100000:3.0:1787833653.816056:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833653.816079:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb71c0b0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833653.816114:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d569a4ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375597568:0@lo:101: 00010000:00010000:3.0:1787833653.816126:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 4/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.816134:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 4/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833653.816150:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375597696 00000100:00100000:3.0:1787833653.816153:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375597696 00000100:00100000:3.0:1787833653.816172:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833653.816178:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007990d29c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5800:x1874679375597696:12345-0@lo:105: 00010000:00010000:3.0:1787833653.816184:0:5799:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 5/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.816191:0:5799:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 5/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.816198:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 5/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.816204:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 6/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.816209:0:5799:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 6/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.816224:0:5799:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 00000000bd8aa0f3) 00000100:00100000:3.0:1787833653.816253:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007990d29c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5800:x1874679375597696:12345-0@lo:105: Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833653.816265:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787833653.816282:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.816289:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000bd8aa0f3/0x2bdb54ee5e774ac9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833653.816368:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d569a4ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375597824:0@lo:501: 00000100:00100000:3.0:1787833653.816394:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833653.816410:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac19bb0c going to sleep for 11 seconds 00000100:00100000:3.0:1787833653.816423:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375597824 00000100:00100000:3.0:1787833653.816426:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375597824 00000100:00100000:3.0:1787833653.816448:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787833653.816453:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000632399e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375597824:12345-0@lo:501: 00000100:00100000:3.0:1787833653.816690:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000632399e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375597824:12345-0@lo:501: Request processed in 237us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833653.816697:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787833653.816730:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032fa2951 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5800:1874679375597696:0@lo:105: 00010000:00010000:3.0:1787833653.816742:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833653.816751:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833653.816777:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079d7119f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:3280:x1874679375597440:12345-0@lo:103: Request processed in 892us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833653.816783:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833653.816809:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba5f409 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375597440:0@lo:103: 00000100:00100000:3.0:1787833653.816832:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d569a4ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375597824:0@lo:501: 00000100:00100000:3.0:1787833653.816876:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d569a4ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375597952:0@lo:503: 00000100:00100000:3.0:1787833653.816912:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833653.816926:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac19bb0c going to sleep for 11 seconds 00000100:00100000:3.0:1787833653.816938:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375597952 00000100:00100000:3.0:1787833653.816941:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375597952 00000100:00100000:3.0:1787833653.816964:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833653.816970:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000726ddaf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375597952:12345-0@lo:503: 00000100:00100000:3.0:1787833653.817106:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000726ddaf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375597952:12345-0@lo:503: Request processed in 136us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833653.817113:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833653.817148:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d569a4ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375597952:0@lo:503: 00010000:00010000:2.0:1787833653.817287:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b9e33188/0x2bdb54ee5e774a83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774a7c expref: 12 pid: 5810 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833653.817301:0:6295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fa49c4e5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6295:1874679375597312:0@lo:104: 00010000:00010000:2.0:1787833653.817316:0:6295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833653.817323:0:6295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833653.817328:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833653.817333:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ca95a34/0x2bdb54ee5e774ac2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833653.821778:0:6296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d569a4ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6296:1874679375598080:0@lo:502: 00000100:00100000:3.0:1787833653.821862:0:6296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833653.821901:0:6296:0:(client.c:2715:ptlrpc_set_wait()) set 000000002df2ec91 going to sleep for 11 seconds 00000100:00100000:0.0:1787833653.822182:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375598080 00000100:00100000:0.0:1787833653.822189:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375598080 00000100:00100000:0.0:1787833653.822941:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787833653.822954:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d868f720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6296:x1874679375598080:12345-0@lo:502: 00000100:00100000:0.0:1787833653.823252:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d868f720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6296:x1874679375598080:12345-0@lo:502: Request processed in 302us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833653.823260:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787833653.832424:0:6296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d569a4ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6296:1874679375598080:0@lo:502: 00000020:01000000:0.0:1787833653.832654:0:6296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833653.832668:0:6296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833653.832671:0:6296:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787833653.832690:0:6296:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6460630000 00000020:00000080:0.0:1787833653.832693:0:6296:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787833653.832769:0:6296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6296:1874679375598208:0@lo:502: 00000100:00100000:0.0:1787833653.832848:0:6296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833653.832895:0:6296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6445cfa240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833653.833159:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375598208 00000100:00100000:2.0:1787833653.833170:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375598208 00000100:00100000:2.0:1787833653.833225:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787833653.833236:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6296:x1874679375598208:12345-0@lo:502: 00000100:00100000:2.0:1787833653.833495:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6296:x1874679375598208:12345-0@lo:502: Request processed in 260us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833653.833504:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787833653.833742:0:6296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6296:1874679375598208:0@lo:502: 00000020:01000000:1.0:1787833653.833769:0:6296:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833653.833781:0:6296:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833653.833783:0:6296:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787833653.833787:0:6296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787833653.840828:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787833653.840865:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787833653.840877:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833653.840889:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833654.591421:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833655.613286:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833656.636618:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833657.665629:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833658.430307:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375598336:0@lo:400: 00000100:00100000:0.0:1787833658.430414:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833658.430524:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375598464:0@lo:400: 00000100:00100000:3.0:1787833658.430560:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833658.430847:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375598464 00000100:00100000:0.0:1787833658.430855:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375598464 00000100:00100000:0.0:1787833658.430914:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833658.430923:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a40b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375598464:12345-0@lo:400: 00000100:00100000:0.0:1787833658.430981:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a40b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375598464:12345-0@lo:400: Request processed in 59us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833658.430988:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787833658.431050:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b64623ea580 x1874679375598464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833658.431064:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375598464:0@lo:400: 00000100:00100000:1.0:1787833658.438112:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375598336 00000100:00100000:1.0:1787833658.438132:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375598336 00000100:00100000:1.0:1787833658.438207:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787833658.438220:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3281:x1874679375598336:12345-0@lo:400: 00000100:00100000:1.0:1787833658.438326:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3281:x1874679375598336:12345-0@lo:400: Request processed in 109us (7912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833658.438334:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787833658.439083:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375598336:0@lo:400: 00010000:00010000:0.0:1787833658.689553:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833659.709924:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833660.734371:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787833661.130570:0:6656:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787833661.130575:0:6656:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787833661.130724:0:6656:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b64773a1800 00000020:01000004:0.0:1787833661.130742:0:6656:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787833661.130757:0:6656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787833661.130774:0:6656:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b6479ca9a48) 00000020:00000080:0.0:1787833661.130793:0:6656:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787833661.172100:0:6656:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787833661.172394:0:6656:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787833661.209804:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787833661.219469:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787833661.219506:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787833661.219569:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787833661.219598:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787833661.219970:0:6656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787833661.219991:0:6656:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787833661.220010:0:6656:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bdb54ee5e774ade 00000020:01000004:3.0:1787833661.220020:0:6656:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787833661.220045:0:6656:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787833661.220629:0:6656:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787833661.220639:0:6656:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787833661.223803:0:6656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787833661.223831:0:6656:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b6443e00000) 00000020:00000080:2.0:1787833661.223854:0:6656:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787833661.230871:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833661.232184:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787833661.232194:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787833661.233613:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787833661.233623:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787833661.234735:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787833661.234743:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787833661.238821:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833661.239036:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787833661.239042:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787833661.242715:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787833661.242731:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787833661.334596:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787833661.334850:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787833661.334858:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787833661.341646:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787833661.341669:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787833661.347679:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787833661.347780:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787833661.356722:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833661.356991:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787833661.357008:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787833661.359980:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787833661.359999:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787833661.510697:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833661.510929:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787833661.510937:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787833661.519603:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787833661.519624:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787833661.524261:0:6656:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787833661.526123:0:6656:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787833661.526136:0:6656:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787833661.610536:0:6656:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787833661.610581:0:6656:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787833661.610586:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787833661.610587:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833661.610589:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833661.610590:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833661.610591:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833661.610593:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833661.610594:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833661.610596:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833661.610597:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833661.610599:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833661.610600:0:6656:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833661.610604:0:6656:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787833661.610606:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787833661.610607:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833661.610608:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833661.610609:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833661.610611:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833661.610612:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833661.610613:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833661.610614:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833661.610615:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833661.610616:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833661.610617:0:6656:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833661.610644:0:6656:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787833661.610663:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375598592:0@lo:253: 00000100:00100000:2.0:1787833661.611923:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.612940:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450bc2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833661.619334:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375598592 00000100:00100000:0.0:1787833661.619366:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375598592 00000100:00100000:1.0:1787833661.619517:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787833661.619529:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375598592:12345-0@lo:253: 20000000:01000000:1.0:1787833661.619570:0:5809:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787833661.619574:0:5809:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787833661.619579:0:5809:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787833661.619583:0:5809:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787833661.621168:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833661.621428:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787833661.621443:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787833661.621483:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787833661.621490:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787833661.621515:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787833661.621559:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787833661.621894:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787833661.621914:0:5809:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:1.0:1787833661.621916:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787833661.627620:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787833661.627667:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787833661.629889:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787833661.629913:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:1.0:1787833661.630163:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787833661.630176:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787833661.630213:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787833661.630271:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787833661.634199:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787833661.634237:0:5809:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:1.0:1787833661.634240:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787833661.634295:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787833661.634303:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787833661.634329:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787833661.634335:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:1.0:1787833661.634639:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787833661.634652:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787833661.634696:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787833661.634755:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787833661.634774:0:5809:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787833661.634788:0:5809:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787833661.634794:0:5809:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787833661.634796:0:5809:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787833661.634798:0:5809:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787833661.634810:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787833661.634813:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787833661.634853:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787833661.634855:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787833661.637577:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787833661.638493:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787833661.638542:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787833661.638638:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787833661.638655:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787833661.638658:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787833661.639832:0:6672:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787833661.639901:0:6672:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787833661.640215:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787833661.640583:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787833661.640620:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787833661.640649:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787833661.640660:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787833661.640662:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787833661.641619:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1787833661.641684:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1787833661.641823:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787833661.642777:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787833661.642831:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787833661.642898:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:3.0:1787833661.642919:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787833661.643182:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.643207:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e7749fe expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.643231:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6482045400/0x2bdb54ee5e774a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a1a expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.643238:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6482044c00/0x2bdb54ee5e774a91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774a8a expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.643244:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.643290:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6482044c00/0x2bdb54ee5e774a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774a8a expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.643305:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6482044c00/0x2bdb54ee5e774a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a8a expref: 12 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833661.643321:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a408780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1874679375598720:0@lo:104: 00000100:00100000:3.0:1787833661.643538:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787833661.643648:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6482045400/0x2bdb54ee5e774a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774a1a expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.643656:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6482045400/0x2bdb54ee5e774a21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a1a expref: 12 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833661.643665:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a408000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1874679375598848:0@lo:104: 00000100:00100000:3.0:1787833661.643686:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787833661.643863:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e7749fe expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.643873:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e7749fe expref: 12 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833661.643917:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a40b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1874679375598976:0@lo:104: 00000100:00100000:3.0:1787833661.643981:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833661.644498:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375598720 00000100:00100000:1.0:1787833661.644506:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375598720 00000100:00100000:3.0:1787833661.644594:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64431e7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787833661.644666:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375598848 00000100:00100000:0.0:1787833661.644672:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375598848 00000100:00100000:0.0:1787833661.644724:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375598976 00000100:00100000:0.0:1787833661.644729:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375598976 00000100:00100000:0.0:1787833661.644747:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787833661.644757:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a40b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:5809:x1874679375598848:12345-0@lo:104: 00010000:00010000:0.0:1787833661.644772:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.644846:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833661.644852:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a40b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:5809:x1874679375598848:12345-0@lo:104: Request processed in 97us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833661.644861:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787833661.644880:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787833661.644886:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:5809:x1874679375598976:12345-0@lo:104: 00010000:00010000:0.0:1787833661.644894:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6482044a00/0x2bdb54ee5e7749fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833661.645559:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a408000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1874679375598848:0@lo:104: 00000100:00100000:3.0:1787833661.645570:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a40b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1874679375598976:0@lo:104: 00010000:00010000:0.0:1787833661.645619:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787833661.645627:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:5809:x1874679375598976:12345-0@lo:104: Request processed in 741us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833661.645636:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787833661.645770:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787833661.645778:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.645786:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c000 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833661.645790:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.645798:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833661.645805:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833661.645811:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787833661.645905:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787833661.645914:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a409e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5809:x1874679375598720:12345-0@lo:104: 00010000:00010000:2.0:1787833661.645925:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.646004:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787833661.646009:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a409e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5809:x1874679375598720:12345-0@lo:104: Request processed in 97us (2473us total) trans 0 rc 0/0 00010000:00010000:1.0:1787833661.646286:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.646293:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833661.646311:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774a1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.646317:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.646361:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787833661.646365:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6482044a00/0x2bdb54ee5e7749fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.646370:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6482044a00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833661.646373:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6482044a00/0x2bdb54ee5e7749fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.646380:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6482044a00/0x2bdb54ee5e7749fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833661.646386:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6482044a00/0x2bdb54ee5e7749fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833661.646391:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787833661.646434:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787833661.646506:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787833661.646525:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833661.646541:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375599104:0@lo:103: 00000100:00100000:0.0:1787833661.646605:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833661.646654:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375599104 00000100:00100000:0.0:1787833661.646661:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375599104 00010000:00010000:0.0:1787833661.646681:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6482045400/0x2bdb54ee5e774a21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a1a expref: 13 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833661.646703:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833661.646724:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64590492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:3282:x1874679375599104:12345-0@lo:103: 00010000:00010000:0.0:1787833661.646736:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833661.646741:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6482045400/0x2bdb54ee5e774a21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a1a expref: 13 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.646750:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6482045400/0x2bdb54ee5e774a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a1a expref: 13 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.646765:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6482045400/0x2bdb54ee5e774a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774a1a expref: 13 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.646780:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833661.646808:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64590492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3282:x1874679375599104:12345-0@lo:103: Request processed in 85us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833661.646815:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833661.646849:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375599104:0@lo:103: 00010000:00010000:2.0:1787833661.648689:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833661.648696:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833661.648699:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833661.648866:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a408780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1874679375598720:0@lo:104: 00010000:00010000:3.0:1787833661.648900:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.648952:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.648961:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031c00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833661.648965:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.649003:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833661.649018:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833661.649024:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787833661.649248:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.649256:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833661.649282:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774a8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.649289:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a91 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.649303:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833661.649305:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833661.649307:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833661.649336:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833661.649377:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375599232:0@lo:103: 00000100:00100000:3.0:1787833661.649432:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833661.649609:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375599232 00000100:00100000:0.0:1787833661.649614:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375599232 00010000:00010000:0.0:1787833661.649638:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6482044c00/0x2bdb54ee5e774a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a8a expref: 12 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833661.649671:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787833661.649680:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3281:x1874679375599232:12345-0@lo:103: 00010000:00010000:0.0:1787833661.649690:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833661.649695:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6482044c00/0x2bdb54ee5e774a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a8a expref: 12 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.649724:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6482044c00/0x2bdb54ee5e774a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774a8a expref: 12 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.649738:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6482044c00/0x2bdb54ee5e774a91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774a8a expref: 12 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.649752:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833661.649794:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:3281:x1874679375599232:12345-0@lo:103: Request processed in 115us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833661.649800:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833661.649967:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375599232:0@lo:103: 00010000:00010000:1.0:1787833661.650366:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6482044a00/0x2bdb54ee5e7749fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.650374:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833661.650399:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6482044a00/0x2bdb54ee5e7749fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.650407:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6482044a00/0x2bdb54ee5e7749fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774a05 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.650422:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833661.650424:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833661.650426:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833661.650528:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375599360:0@lo:103: 00000100:00100000:2.0:1787833661.650567:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833661.650651:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375599360 00000100:00100000:3.0:1787833661.650656:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375599360 00010000:00010000:3.0:1787833661.650677:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e7749fe expref: 11 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833661.650715:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833661.650724:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:3281:x1874679375599360:12345-0@lo:103: 00010000:00010000:3.0:1787833661.650732:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833661.650736:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e7749fe expref: 11 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650746:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e7749fe expref: 11 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650757:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e7749fe expref: 11 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650777:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650785:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650798:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650804:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650811:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650817:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650823:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2cc00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833661.650826:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650834:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650854:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.650863:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833661.650896:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:3281:x1874679375599360:12345-0@lo:103: Request processed in 174us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.650911:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833661.650952:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375599360:0@lo:103: 00010000:00010000:1.0:1787833661.651009:0:5809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.651036:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.651043:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2cc00/0x2bdb54ee5e774aec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787833661.651064:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787833661.736675:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:6656:x1874679375598592:12345-0@lo:253: Request processed in 117135us (124748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833661.736693:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787833661.736813:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375598592:0@lo:253: 10000000:01000000:2.0:1787833661.736830:0:6656:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787833661.736834:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787833661.736836:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833661.736838:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833661.736839:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787833661.736841:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833661.736842:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833661.736844:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833661.736845:0:6656:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787833661.736847:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833661.736849:0:6656:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787833661.736873:0:6656:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b64773a1800 from lustre-OST0000 10000000:01000000:2.0:1787833661.736902:0:6656:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787833661.736905:0:6656:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787833661.736913:0:6656:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6443fdced8 local copy 10000000:01000000:2.0:1787833661.736917:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787833661.737004:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.737146:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.737158:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833661.737264:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375599488:0@lo:101: 00000100:00100000:2.0:1787833661.737309:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.737409:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833661.737476:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375599488 00000100:00100000:1.0:1787833661.737483:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375599488 00000100:00100000:1.0:1787833661.737530:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787833661.737539:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:6656:x1874679375599488:12345-0@lo:101: 00010000:00010000:1.0:1787833661.737554:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833661.737569:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462199600/0x2bdb54ee5e774afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774af3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.737596:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199600/0x2bdb54ee5e774afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774af3 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.737607:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462199600/0x2bdb54ee5e774afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774af3 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.737617:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199600, rc 0) 00000100:00100000:1.0:1787833661.737658:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:6656:x1874679375599488:12345-0@lo:101: Request processed in 120us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833661.737665:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787833661.737741:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375599488:0@lo:101: 00010000:00010000:2.0:1787833661.737753:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.737762:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833661.737859:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375599616:0@lo:501: 00000100:00100000:2.0:1787833661.737881:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.737902:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833661.737977:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375599616 00000100:00100000:0.0:1787833661.737982:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375599616 00000100:00100000:0.0:1787833661.738131:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787833661.738142:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:6656:x1874679375599616:12345-0@lo:501: 00000100:00100000:0.0:1787833661.738459:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:6656:x1874679375599616:12345-0@lo:501: Request processed in 319us (576us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833661.738467:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787833661.738551:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375599616:0@lo:501: 10000000:01000000:2.0:1787833661.738566:0:6656:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787833661.738595:0:6656:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787833661.738600:0:6656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.738610:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.738617:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.738642:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787833661.738669:0:6656:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b64773a1800 10000000:01000000:2.0:1787833661.738674:0:6656:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787833661.738679:0:6656:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b6443fdced8 10000000:01000000:2.0:1787833661.738682:0:6656:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787833661.738685:0:6656:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b6443fdced8 from 1 10000000:01000000:2.0:1787833661.738688:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787833661.738708:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.738716:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.738723:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833661.738736:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375599744:0@lo:101: 00000100:00100000:2.0:1787833661.738764:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.738785:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787833661.738845:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375599744 00000100:00100000:1.0:1787833661.738850:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375599744 00000100:00100000:1.0:1787833661.738879:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787833661.738886:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:6656:x1874679375599744:12345-0@lo:101: 00010000:00010000:1.0:1787833661.738894:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833661.738905:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774b08 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774b01 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.738920:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774b08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b01 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.738941:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774b08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b01 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.738948:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199c00, rc 0) 00000100:00100000:1.0:1787833661.738992:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375599744:12345-0@lo:101: Request processed in 106us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833661.738999:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1787833661.739280:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833661.739288:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.739296:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83c00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833661.739301:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.739310:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833661.739328:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833661.739335:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787833661.739390:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.739397:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833661.739418:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.739425:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bdb54ee5e774afa expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.739443:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833661.739446:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833661.739447:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833661.739500:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375599872:0@lo:103: 00000100:00100000:1.0:1787833661.739532:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.739646:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375599744:0@lo:101: 00010000:00010000:2.0:1787833661.739660:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b08 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.739668:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774b08 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833661.739684:0:6656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:0.0:1787833661.739756:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375599872 00000100:00100000:0.0:1787833661.739761:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375599872 00000100:00100000:0.0:1787833661.739795:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833661.739802:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:3282:x1874679375599872:12345-0@lo:103: 00010000:00010000:0.0:1787833661.739812:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833661.739824:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462199600/0x2bdb54ee5e774afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774af3 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.739836:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833661.739866:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:3282:x1874679375599872:12345-0@lo:103: Request processed in 64us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833661.739873:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787833661.739920:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b08 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.739937:0:6656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b08 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833661.739951:0:6656:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787833661.739955:0:6656:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787833661.739961:0:6656:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787833661.739964:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787833661.739994:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.740000:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.740008:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833661.740094:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600000:0@lo:101: 00000100:00100000:2.0:1787833661.740122:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.740148:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833661.740279:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375600000 00000100:00100000:0.0:1787833661.740283:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375600000 00000100:00100000:0.0:1787833661.740316:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787833661.740325:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+10:6656:x1874679375600000:12345-0@lo:101: 00010000:00010000:0.0:1787833661.740335:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833661.740383:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774b0f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.740399:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b0f expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.740407:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b0f expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.740414:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031c00, rc 0) 00000100:00100000:0.0:1787833661.740443:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600000:12345-0@lo:101: Request processed in 120us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833661.740450:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787833661.740916:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600000:0@lo:101: 00010000:00010000:2.0:1787833661.740943:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.740952:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833661.741267:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600128:0@lo:501: 00000100:00100000:2.0:1787833661.741302:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.741369:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833661.741460:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375599872:0@lo:103: 00000100:00100000:3.0:1787833661.741518:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375600128 00000100:00100000:3.0:1787833661.741524:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375600128 00000100:00100000:3.0:1787833661.741563:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787833661.741572:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600128:12345-0@lo:501: 00000100:00100000:3.0:1787833661.741821:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600128:12345-0@lo:501: Request processed in 249us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.741829:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787833661.741937:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600128:0@lo:501: 00000100:00100000:2.0:1787833661.741989:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600256:0@lo:503: 00000100:00100000:2.0:1787833661.742150:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833661.742256:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375600256 00000100:00100000:0.0:1787833661.742261:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375600256 00000100:00100000:0.0:1787833661.742296:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787833661.742303:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600256:12345-0@lo:503: 00000100:00100000:0.0:1787833661.742487:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600256:12345-0@lo:503: Request processed in 184us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833661.742494:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787833661.742570:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787833661.742585:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600256:0@lo:503: 00000040:00080000:2.0:1787833661.742860:0:6656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787833661.743007:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600384:0@lo:502: 00000100:00100000:2.0:1787833661.743112:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.743144:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833661.743280:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375600384 00000100:00100000:3.0:1787833661.743286:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375600384 00000100:00100000:3.0:1787833661.743321:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787833661.743328:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600384:12345-0@lo:502: 00000100:00100000:3.0:1787833661.743782:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600384:12345-0@lo:502: Request processed in 453us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.743790:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787833661.743900:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600384:0@lo:502: 00000040:00080000:2.0:1787833661.744625:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787833661.744688:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787833661.744723:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787833661.744771:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787833661.744810:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787833661.744843:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787833661.744880:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600512:0@lo:502: 00000100:00100000:2.0:1787833661.745152:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.745306:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833661.745452:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375600512 00000100:00100000:3.0:1787833661.745460:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375600512 00000100:00100000:3.0:1787833661.745540:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787833661.745549:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600512:12345-0@lo:502: 00000100:00100000:3.0:1787833661.745752:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600512:12345-0@lo:502: Request processed in 204us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.745760:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787833661.745839:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600512:0@lo:502: 00000040:00080000:0.0:1787833661.745965:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787833661.745995:0:6656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787833661.746658:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787833661.746668:0:6676:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787833661.746676:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833661.746678:0:6676:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787833661.746683:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787833661.746697:0:6676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b6479cab490) 00000020:00000080:0.0:1787833661.746717:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787833661.746723:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787833661.746796:0:6676:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b64773a1800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787833661.746804:0:6676:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787833661.746811:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bdb54ee5e774b24 00010000:00010000:2.0:1787833661.754617:0:6676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787833661.754986:0:6676:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00010000:00010000:0.0:1787833661.756487:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787833661.757823:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787833661.758168:0:6676:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787833661.767428:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787833661.767910:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787833661.772991:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787833661.773006:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833661.773024:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833661.773033:0:6676:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787833661.773038:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833661.773042:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833661.773044:0:6676:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787833661.773047:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787833661.773049:0:6676:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787833661.773115:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833661.773120:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833661.773121:0:6676:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787833661.773124:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787833661.775119:0:6656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787833661.775165:0:6656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787833661.775545:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.775559:0:6656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833661.775568:0:6656:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b64773a1800 from 1 10000000:01000000:0.0:1787833661.775571:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787833661.775616:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.775624:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.775636:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833661.775678:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600640:0@lo:101: 00000100:00100000:0.0:1787833661.775760:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833661.775814:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833661.775843:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375600640 00000100:00100000:0.0:1787833661.775852:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375600640 00000100:00100000:0.0:1787833661.775902:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787833661.775911:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:6656:x1874679375600640:12345-0@lo:101: 00010000:00010000:0.0:1787833661.775926:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833661.775942:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774b2b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.775966:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b2b expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.775991:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b2b expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.776000:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031e00, rc 0) 00000100:00100000:0.0:1787833661.776122:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375600640:12345-0@lo:101: Request processed in 210us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833661.776130:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787833661.776261:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600640:0@lo:101: 00010000:00010000:0.0:1787833661.776277:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.776286:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833661.776420:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600768:0@lo:501: 00000100:00100000:0.0:1787833661.776448:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833661.776462:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833661.776531:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375600768 00000100:00100000:3.0:1787833661.776536:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375600768 00000100:00100000:3.0:1787833661.776567:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787833661.776581:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375600768:12345-0@lo:501: 00000100:00100000:3.0:1787833661.776822:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375600768:12345-0@lo:501: Request processed in 241us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.776828:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787833661.777743:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600768:0@lo:501: 00000100:00100000:0.0:1787833661.777785:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600896:0@lo:503: 00000100:00100000:0.0:1787833661.777835:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833661.777870:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833661.777913:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375600896 00000100:00100000:3.0:1787833661.777918:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375600896 00000100:00100000:3.0:1787833661.778001:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787833661.778019:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375600896:12345-0@lo:503: 00000100:00100000:3.0:1787833661.778448:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375600896:12345-0@lo:503: Request processed in 438us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.778456:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787833661.778645:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375600896:0@lo:503: 00000040:00080000:1.0:1787833661.778931:0:6656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787833661.779024:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601024:0@lo:502: 00000100:00100000:1.0:1787833661.779071:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833661.779399:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833661.779519:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375601024 00000100:00100000:0.0:1787833661.779525:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375601024 00000100:00100000:0.0:1787833661.779553:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787833661.779560:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375601024:12345-0@lo:502: 00000100:00100000:0.0:1787833661.779772:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375601024:12345-0@lo:502: Request processed in 211us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833661.779780:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787833661.779894:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601024:0@lo:502: 00000040:00080000:1.0:1787833661.780333:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787833661.780723:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787833661.780763:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601152:0@lo:502: 00000100:00100000:1.0:1787833661.780819:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833661.780855:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833661.780953:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375601152 00000100:00100000:0.0:1787833661.780960:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375601152 00000100:00100000:0.0:1787833661.781111:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787833661.781123:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375601152:12345-0@lo:502: 00000100:00100000:0.0:1787833661.781294:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375601152:12345-0@lo:502: Request processed in 173us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833661.781369:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601152:0@lo:502: 00000040:00080000:1.0:1787833661.781454:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787833661.781463:0:6656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787833661.781926:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833661.781935:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833661.781938:0:6680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787833661.781944:0:6680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b64773a1800 00000020:00000080:2.0:1787833661.781946:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787833661.781962:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833661.781966:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833661.781981:0:6680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787833661.781984:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787833661.782096:0:6656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787833661.782114:0:6656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787833661.782130:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.782141:0:6656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833661.782242:0:6656:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787833661.782245:0:6656:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b64773a1800 10000000:01000000:2.0:1787833661.782248:0:6656:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b64773a1800 10000000:01000000:2.0:1787833661.782252:0:6656:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787833661.782258:0:6656:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b64773a1800 from 1 10000000:01000000:2.0:1787833661.782260:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833661.782303:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.782311:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.782321:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833661.782360:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462316580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601280:0@lo:101: 00000100:00100000:2.0:1787833661.782402:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.782433:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787833661.782453:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375601280 00000100:00100000:2.0:1787833661.782459:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375601280 00000100:00100000:0.0:1787833661.782674:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787833661.782789:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787833661.782799:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375601280:12345-0@lo:101: 00010000:00010000:2.0:1787833661.782812:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833661.782825:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774b39 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.782849:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b39 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.782859:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b39 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.782867:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83600, rc 0) 00000100:00100000:2.0:1787833661.782915:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375601280:12345-0@lo:101: Request processed in 117us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833661.782921:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787833661.783020:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462316580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601280:0@lo:101: 00010000:00010000:0.0:1787833661.783036:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833661.783055:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833661.783144:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601408:0@lo:501: 00000100:00100000:0.0:1787833661.783171:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833661.783386:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833661.783480:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375601408 00000100:00100000:3.0:1787833661.783485:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375601408 00000100:00100000:3.0:1787833661.783508:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787833661.783514:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375601408:12345-0@lo:501: 00000100:00100000:3.0:1787833661.783730:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375601408:12345-0@lo:501: Request processed in 215us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.783738:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787833661.783814:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601408:0@lo:501: 00000100:00100000:0.0:1787833661.783842:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601536:0@lo:503: 00000100:00100000:0.0:1787833661.783881:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833661.783910:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833661.783954:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375601536 00000100:00100000:3.0:1787833661.783960:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375601536 00000100:00100000:3.0:1787833661.783989:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787833661.783994:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375601536:12345-0@lo:503: 00000100:00100000:3.0:1787833661.784291:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375601536:12345-0@lo:503: Request processed in 295us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.784298:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833661.784388:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601536:0@lo:503: 00000040:00080000:0.0:1787833661.784638:0:6656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787833661.784723:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601664:0@lo:502: 00000100:00100000:0.0:1787833661.784759:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833661.784784:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833661.784865:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375601664 00000100:00100000:3.0:1787833661.784870:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375601664 00000100:00100000:3.0:1787833661.784893:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787833661.784898:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375601664:12345-0@lo:502: 00000100:00100000:3.0:1787833661.785391:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375601664:12345-0@lo:502: Request processed in 491us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.785398:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787833661.785482:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601664:0@lo:502: 00000040:00080000:0.0:1787833661.785730:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787833661.785782:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787833661.785814:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787833661.785861:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787833661.785899:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787833661.785948:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787833661.785997:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787833661.786296:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787833661.786570:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787833661.786617:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787833661.786653:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787833661.786720:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787833661.786758:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787833661.786792:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787833661.786837:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787833661.786874:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787833661.786907:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787833661.786954:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787833661.787005:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787833661.787121:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787833661.787257:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787833661.787306:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787833661.787524:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787833661.787586:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787833661.787625:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787833661.787657:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787833661.787703:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787833661.787739:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787833661.787784:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601792:0@lo:502: 00000100:00100000:1.0:1787833661.787851:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833661.787935:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601eb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787833661.787994:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375601792 00000100:00100000:3.0:1787833661.788000:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375601792 00000100:00100000:3.0:1787833661.788168:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787833661.788253:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375601792:12345-0@lo:502: 00000100:00100000:3.0:1787833661.788507:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375601792:12345-0@lo:502: Request processed in 329us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833661.788515:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787833661.788611:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375601792:0@lo:502: 00000040:00080000:1.0:1787833661.788694:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787833661.788705:0:6656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787833661.789430:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787833661.789447:0:6681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b6443fdb490) 00000020:00000080:1.0:1787833661.789471:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787833661.789550:0:6681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b64773a1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787833661.789554:0:6681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b64773a1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787833661.789557:0:6681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b64773a1800 3 00010000:00080000:1.0:1787833661.789589:0:6681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b647f839800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787833661.792939:0:6681:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787833661.793447:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787833661.793484:0:6681:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787833661.793497:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2bdb54ee5e774b4e 00000100:00080000:1.0:1787833661.793508:0:6681:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787833661.793514:0:6681:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b647f839800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787833661.793553:0:6681:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b64623e9e00 x1874679375601920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787833661.793581:0:6681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787833661.793860:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375602048:0@lo:400: 00000100:00100000:2.0:1787833661.793931:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.794008:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375602048 00000100:00100000:2.0:1787833661.794089:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375602048 00000100:00100000:2.0:1787833661.794134:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787833661.794143:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375602048:12345-0@lo:400: 00000100:00100000:2.0:1787833661.794271:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375602048:12345-0@lo:400: Request processed in 129us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833661.794278:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787833661.794318:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6462314b40 x1874679375602048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833661.794332:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375602048:0@lo:400: 00000100:00100000:3.0:1787833661.794445:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1874679375601920:0@lo:38: 00000100:00100000:3.0:1787833661.794481:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833661.794562:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375601920 00000100:00100000:2.0:1787833661.794566:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375601920 00000100:00100000:2.0:1787833661.794590:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787833661.794595:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1874679375601920:12345-0@lo:38: 00010000:00080000:2.0:1787833661.794628:0:5815:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:2.0:1787833661.794657:0:5815:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2bdb54ee5e774b55 00000004:00100000:2.0:1787833661.794672:0:5815:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787833661.794700:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9b64451c8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833661.794738:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874679375601920:12345-0@lo:38: Request processed in 142us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833661.794745:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787833661.794771:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623e9e00 x1874679375601920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833661.794780:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787833661.794799:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787833661.794805:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787833661.794810:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787833661.794813:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b647f839800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787833661.794818:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1874679375601920:0@lo:38: 00000040:00080000:1.0:1787833661.795092:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787833661.795486:0:6656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787833661.795514:0:6656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787833661.795535:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.795545:0:6656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787833661.795587:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787833661.795593:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787833661.795594:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833661.795595:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833661.795596:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833661.795598:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833661.795599:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787833661.795600:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833661.795601:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833661.795603:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833661.795604:0:6656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787833661.795608:0:6656:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787833661.795610:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787833661.795611:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787833661.795612:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833661.795613:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833661.795614:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833661.795615:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833661.795616:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787833661.795617:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833661.795618:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833661.795618:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833661.795619:0:6656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787833661.795636:0:6656:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787833661.795649:0:6656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375602176:0@lo:253: 00000100:00100000:1.0:1787833661.795701:0:6656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833661.795792:0:6656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601ebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833661.798645:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375602176 00000100:00100000:3.0:1787833661.798659:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375602176 00000100:00100000:3.0:1787833661.798723:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787833661.798733:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6656:x1874679375602176:12345-0@lo:253: 20000000:01000000:3.0:1787833661.798766:0:5810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787833661.798783:0:5810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787833661.844801:0:5810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787833661.844824:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787833661.845468:0:5831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787833661.845475:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787833661.845502:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.845522:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774aad expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.845531:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.845589:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774aad expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833661.845603:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774aad expref: 13 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833661.845619:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874679375602304:0@lo:104: 00000100:00100000:3.0:1787833661.845694:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833661.845765:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64431e7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833661.845943:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787833661.845958:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375602304 00000100:00100000:2.0:1787833661.845976:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375602304 00000100:00100000:2.0:1787833661.846033:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787833661.846043:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64440d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5831:x1874679375602304:12345-0@lo:104: 00010000:00010000:2.0:1787833661.846066:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6462198000/0x2bdb54ee5e774aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833661.846131:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833661.846137:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64440d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5831:x1874679375602304:12345-0@lo:104: Request processed in 96us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833661.846144:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787833661.846666:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874679375602304:0@lo:104: 00010000:00010000:3.0:1787833661.846688:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.853627:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833661.853646:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462198000/0x2bdb54ee5e774aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.853660:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833661.853664:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198000/0x2bdb54ee5e774aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.853675:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462198000/0x2bdb54ee5e774aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833661.853702:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198000/0x2bdb54ee5e774aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833661.853708:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833661.853760:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6462198000/0x2bdb54ee5e774aad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.853767:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833661.853790:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462198000/0x2bdb54ee5e774aad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.853797:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462198000/0x2bdb54ee5e774aad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774ab4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.853813:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833661.853816:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833661.853818:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833661.853831:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833661.853849:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375602432:0@lo:103: 00000100:00100000:1.0:1787833661.854633:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833661.854710:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375602432 00000100:00100000:1.0:1787833661.854718:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375602432 00010000:00010000:1.0:1787833661.854751:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774aad expref: 14 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833661.854784:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787833661.854793:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446009c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:3281:x1874679375602432:12345-0@lo:103: 00010000:00010000:1.0:1787833661.854807:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833661.854812:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774aad expref: 14 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854835:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774aad expref: 14 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854852:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774ab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774aad expref: 14 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854869:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854877:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787833661.854897:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009421334s 00010000:00010000:1.0:1787833661.854914:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854923:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854936:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854942:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854948:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833661.854952:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854960:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.854996:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.855007:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833661.855056:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446009c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:3281:x1874679375602432:12345-0@lo:103: Request processed in 263us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833661.855064:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787833661.855127:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.855137:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833661.855143:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774b5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833661.855180:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375602432:0@lo:103: 00000100:00100000:2.0:1787833661.862012:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:6656:x1874679375602176:12345-0@lo:253: Request processed in 63268us (66299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833661.862031:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787833661.862190:0:6656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:6656:1874679375602176:0@lo:253: 10000000:01000000:1.0:1787833661.862207:0:6656:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787833661.862211:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787833661.862212:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787833661.862214:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833661.862215:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833661.862216:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833661.862217:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833661.862219:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787833661.862221:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787833661.862222:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787833661.862224:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833661.862225:0:6656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787833661.862238:0:6656:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787833661.877714:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787833661.877916:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787833661.878138:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787833661.878336:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787833661.878620:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787833661.878846:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787833661.888860:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787833662.177067:0:6656:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787833662.177079:0:6656:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787833662.177132:0:6656:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787833662.177203:0:6656:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787833662.177217:0:6656:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787833662.177251:0:6656:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787833662.780671:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833663.804908:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787833663.874321:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787833663.874331:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6460630000 from 21 10000000:01000000:2.0:1787833663.874371:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833663.874416:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.874429:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.874440:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833663.874463:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375602560:0@lo:101: 00000100:00100000:2.0:1787833663.874545:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.874598:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.874623:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375602560 00000100:00100000:2.0:1787833663.874630:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375602560 00000100:00100000:2.0:1787833663.874685:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787833663.874695:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5812:x1874679375602560:12345-0@lo:101: 00010000:00010000:2.0:1787833663.874710:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833663.874725:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774b63 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.874750:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b63 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.874761:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b63 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.874769:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c82200, rc 0) 00000100:00100000:2.0:1787833663.874809:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375602560:12345-0@lo:101: Request processed in 115us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.874825:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787833663.874871:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375602560:0@lo:101: 00010000:00010000:2.0:1787833663.874887:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.874895:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833663.874960:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375602688:0@lo:501: 00000100:00100000:2.0:1787833663.874985:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.874999:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.875010:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375602688 00000100:00100000:2.0:1787833663.875013:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375602688 00000100:00100000:2.0:1787833663.875034:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787833663.875040:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375602688:12345-0@lo:501: 00000100:00100000:2.0:1787833663.875408:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375602688:12345-0@lo:501: Request processed in 366us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.875415:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787833663.875446:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375602688:0@lo:501: 00000100:00100000:2.0:1787833663.875475:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375602816:0@lo:503: 00000100:00100000:2.0:1787833663.875513:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.875526:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.875537:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375602816 00000100:00100000:2.0:1787833663.875540:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375602816 00000100:00100000:2.0:1787833663.875561:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787833663.875567:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375602816:12345-0@lo:503: 00000100:00100000:2.0:1787833663.875844:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375602816:12345-0@lo:503: Request processed in 277us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.875850:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787833663.875886:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375602816:0@lo:503: 00000100:00100000:2.0:1787833663.876081:0:6764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6764:1874679375602944:0@lo:502: 00000100:00100000:2.0:1787833663.876113:0:6764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.876132:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375602944 00000100:00100000:2.0:1787833663.876135:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375602944 00000100:00100000:2.0:1787833663.876155:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787833663.876162:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6764:x1874679375602944:12345-0@lo:502: 00000100:00100000:2.0:1787833663.876375:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6764:x1874679375602944:12345-0@lo:502: Request processed in 213us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.876383:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787833663.876411:0:6764:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.876423:0:6764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6764:1874679375602944:0@lo:502: 00000100:00100000:2.0:1787833663.876465:0:6764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6764:1874679375603072:0@lo:502: 00000100:00100000:2.0:1787833663.876495:0:6764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.876514:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375603072 00000100:00100000:2.0:1787833663.876517:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375603072 00000100:00100000:2.0:1787833663.876536:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787833663.876542:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6764:x1874679375603072:12345-0@lo:502: 00000100:00100000:2.0:1787833663.876643:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:6764:x1874679375603072:12345-0@lo:502: Request processed in 100us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.876649:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787833663.876676:0:6764:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.876692:0:6764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6764:1874679375603072:0@lo:502: 00000040:00080000:2.0:1787833663.876710:0:6764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787833663.876765:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787833663.876781:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787833663.876790:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.876800:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833663.876808:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787833663.876810:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6460630000 from 4 10000000:01000000:2.0:1787833663.876813:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787833663.876835:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.876843:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.876852:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833663.876865:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603200:0@lo:101: 00000100:00100000:2.0:1787833663.876889:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.876902:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.876912:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375603200 00000100:00100000:2.0:1787833663.876915:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375603200 00000100:00100000:2.0:1787833663.876934:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787833663.876939:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375603200:12345-0@lo:101: 00010000:00010000:2.0:1787833663.876947:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833663.876978:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774b71 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.876998:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b71 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877007:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b71 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877016:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83200, rc 0) 00000100:00100000:2.0:1787833663.877044:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375603200:12345-0@lo:101: Request processed in 105us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.877050:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787833663.877078:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603200:0@lo:101: 00010000:00010000:2.0:1787833663.877090:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877097:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833663.877135:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603328:0@lo:256: 00000100:00100000:2.0:1787833663.877161:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.877174:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.877183:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375603328 00000100:00100000:2.0:1787833663.877186:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375603328 00000100:00100000:2.0:1787833663.877205:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787833663.877211:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375603328:12345-0@lo:256: 20000000:01000000:2.0:1787833663.877222:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787833663.877237:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787833663.877243:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787833663.877312:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375603328:12345-0@lo:256: Request processed in 101us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.877319:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787833663.877370:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603328:0@lo:256: 10000000:01000000:2.0:1787833663.877407:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787833663.877412:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877419:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833663.877424:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787833663.877426:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787833663.877428:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787833663.877441:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877447:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877453:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833663.877463:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603456:0@lo:101: 00000100:00100000:2.0:1787833663.877485:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.877499:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.877508:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375603456 00000100:00100000:2.0:1787833663.877511:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375603456 00000100:00100000:2.0:1787833663.877529:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787833663.877540:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375603456:12345-0@lo:101: 00010000:00010000:2.0:1787833663.877547:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833663.877554:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774b7f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877566:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b7f expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877573:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b7f expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877579:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83e00, rc 0) 00000100:00100000:2.0:1787833663.877605:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375603456:12345-0@lo:101: Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.877610:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787833663.877637:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603456:0@lo:101: 00010000:00010000:2.0:1787833663.877646:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833663.877654:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833663.877692:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603584:0@lo:501: 00000100:00100000:2.0:1787833663.877713:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.877726:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.877736:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375603584 00000100:00100000:2.0:1787833663.877739:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375603584 00000100:00100000:2.0:1787833663.877756:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787833663.877762:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375603584:12345-0@lo:501: 00000100:00100000:2.0:1787833663.882908:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375603584:12345-0@lo:501: Request processed in 5138us (5186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.882924:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787833663.883061:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603584:0@lo:501: 00000100:00100000:3.0:1787833663.883129:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603712:0@lo:503: 00000100:00100000:3.0:1787833663.883186:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833663.883227:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64431e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833663.884968:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375603712 00000100:00100000:2.0:1787833663.884980:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375603712 00000100:00100000:2.0:1787833663.885032:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787833663.885041:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375603712:12345-0@lo:503: 00000100:00100000:2.0:1787833663.885447:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375603712:12345-0@lo:503: Request processed in 407us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.885455:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787833663.885640:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375603712:0@lo:503: 00000100:00100000:3.0:1787833663.887117:0:6765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6765:1874679375603840:0@lo:502: 00000100:00100000:3.0:1787833663.887206:0:6765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833663.887252:0:6765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64431e7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833663.887371:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375603840 00000100:00100000:1.0:1787833663.887379:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375603840 00000100:00100000:1.0:1787833663.887419:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787833663.887428:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:6765:x1874679375603840:12345-0@lo:502: 00000100:00100000:1.0:1787833663.887695:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:6765:x1874679375603840:12345-0@lo:502: Request processed in 266us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833663.887703:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787833663.888393:0:6765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6765:1874679375603840:0@lo:502: 00000020:01000000:3.0:1787833663.888430:0:6765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787833663.888439:0:6765:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787833663.888446:0:6765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833663.888456:0:6765:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787833663.888465:0:6765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787833663.888469:0:6765:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:3.0:1787833663.888491:0:6765:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787833663.888494:0:6765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833663.888518:0:6765:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b6452f28000) 00000020:00000080:3.0:1787833663.888542:0:6765:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787833663.888548:0:6765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787833663.888621:0:6765:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787833663.888626:0:6765:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787833663.888631:0:6765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e774b94 00010000:00080000:3.0:1787833663.888659:0:6765:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b647fa67000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:3.0:1787833663.888881:0:6765:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787833663.982546:0:6765:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787833663.982575:0:6765:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787833663.983201:0:6765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833663.983397:0:6765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833663.983452:0:6765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787833663.983525:0:6765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787833663.994371:0:6769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833663.994382:0:6769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787833663.998076:0:6765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787833663.998093:0:6765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787833663.998156:0:6765:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787833663.998180:0:6765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e774b9b 00000100:00080000:0.0:1787833663.998191:0:6765:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787833663.998197:0:6765:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b647fa67000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787833663.998236:0:6765:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6459049a40 x1874679375603968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787833663.998271:0:6765:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787833663.998470:0:6765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833663.998475:0:6765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833663.998477:0:6765:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787833663.998480:0:6765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833663.998483:0:6765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1787833663.998591:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459049a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375603968:0@lo:8: 00000100:00100000:2.0:1787833663.998679:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833663.998770:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375603968 00000100:00100000:2.0:1787833663.998778:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375603968 00000100:00100000:2.0:1787833663.998810:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833663.998817:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1874679375603968:12345-0@lo:8: 00010000:00080000:2.0:1787833663.998840:0:6659:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:2.0:1787833663.998864:0:6659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e774ba2 00002000:00100000:2.0:1787833663.998898:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b64451cb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787833663.998902:0:6659:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787833663.998906:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787833663.999061:0:6659:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787833663.999231:0:6659:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787833663.999255:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b64451ce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833663.999306:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1874679375603968:12345-0@lo:8: Request processed in 488us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833663.999323:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:0.0:1787833663.999793:0:6765:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787833663.999805:0:6765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787833663.999807:0:6765:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787833663.999843:0:6765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6765:1874679375604096:0@lo:502: 00000100:00100000:0.0:1787833663.999894:0:6765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833664.000478:0:6765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b63411843c0 going to sleep for 10 seconds 00000100:00100000:0.0:1787833664.000606:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375604096 00000100:00100000:0.0:1787833664.000612:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375604096 00010000:00080000:2.0:1787833664.000834:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6459049a40 x1874679375603968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787833673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833664.000845:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787833664.000854:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787833664.000861:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787833664.000867:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787833664.000870:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b647fa67000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787833664.000882:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787833664.000887:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459049a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375603968:0@lo:8: 00000100:00100000:1.0:1787833664.001082:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375604224:0@lo:400: 00000100:00100000:1.0:1787833664.001131:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833664.001170:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375604352:0@lo:400: 00000100:00100000:1.0:1787833664.001195:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833664.001292:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787833664.001302:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:6765:x1874679375604096:12345-0@lo:502: 00000100:00100000:2.0:1787833664.001447:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375604224 00000100:00100000:2.0:1787833664.001452:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375604224 00000100:00100000:2.0:1787833664.001479:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375604352 00000100:00100000:2.0:1787833664.001481:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375604352 00000004:00080000:1.0:1787833664.001645:0:6769:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787833664.001801:0:6769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 142757460350ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787833664.002010:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833664.002018:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375604224:12345-0@lo:400: 00000100:00100000:2.0:1787833664.002076:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375604224:12345-0@lo:400: Request processed in 59us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833664.002083:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833664.002100:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833664.002106:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375604352:12345-0@lo:400: 00000100:00100000:2.0:1787833664.002138:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375604352:12345-0@lo:400: Request processed in 33us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833664.002144:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787833664.002167:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787833664.002194:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623ea580 x1874679375604224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833664.002215:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375604224:0@lo:400: 00010000:00080000:2.0:1787833664.002245:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623e9680 x1874679375604352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833664.002254:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375604352:0@lo:400: 00000100:00100000:0.0:1787833664.003590:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:6765:x1874679375604096:12345-0@lo:502: Request processed in 2282us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833664.003604:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787833664.004222:0:6765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:6765:1874679375604096:0@lo:502: 00000020:01000000:2.0:1787833664.004258:0:6765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833664.004266:0:6765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833664.004269:0:6765:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787833664.004273:0:6765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787833664.009638:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787833664.009679:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787833664.009692:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833664.009711:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833664.009724:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787833664.009728:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6443fdced8 from 1 10000000:01000000:0.0:1787833664.009731:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787833664.009774:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833664.009783:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833664.009795:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833664.009820:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375604480:0@lo:101: 00000100:00100000:0.0:1787833664.009893:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833664.009965:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341184240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833664.009989:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375604480 00000100:00100000:0.0:1787833664.009995:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375604480 00000100:00100000:0.0:1787833664.010034:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787833664.010041:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375604480:12345-0@lo:101: 00010000:00010000:0.0:1787833664.010062:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833664.010074:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774ba9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833664.010096:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774ba9 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833664.010107:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774ba9 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833664.010115:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440030c00, rc 0) 00000100:00100000:0.0:1787833664.010151:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375604480:12345-0@lo:101: Request processed in 109us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833664.010157:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787833664.010202:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375604480:0@lo:101: 00010000:00010000:0.0:1787833664.010215:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833664.010223:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833664.010271:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375604608:0@lo:501: 00000100:00100000:0.0:1787833664.010296:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833664.010308:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341184240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833664.010331:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375604608 00000100:00100000:0.0:1787833664.010334:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375604608 00000100:00100000:0.0:1787833664.010562:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787833664.010568:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375604608:12345-0@lo:501: 00000100:00100000:0.0:1787833664.010800:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375604608:12345-0@lo:501: Request processed in 231us (503us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833664.010808:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787833664.010841:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375604608:0@lo:501: 10000000:01000000:0.0:1787833664.010866:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787833664.010873:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833664.010880:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833664.115839:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787833664.117152:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375604736:0@lo:13: 00000100:00100000:2.0:1787833664.117226:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787833664.117289:0:6770:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787833664.117313:0:6770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874679375604864:0@lo:7: 00000100:00100000:1.0:1787833664.117659:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833664.117683:0:6770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fe2d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787833664.119247:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375604864 00000100:00100000:2.0:1787833664.119261:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375604864 00000100:00100000:2.0:1787833664.119327:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833664.119367:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6770:x1874679375604864:12345-0@lo:7: 00000100:00100000:0.0:1787833664.123262:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375604736 00000100:00100000:0.0:1787833664.123277:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375604736 00000100:00100000:0.0:1787833664.123336:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833664.123359:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375604736:12345-0@lo:13: 00002000:00000024:0.0:1787833664.123393:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787833664.123482:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375604736:12345-0@lo:13: Request processed in 125us (6256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833664.123491:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1787833664.125562:0:6661:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787833664.125570:0:6661:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:0.0:1787833664.125889:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623ead00 x1874679375604736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833664.125998:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375604736:0@lo:13: 00000100:00080000:0.0:1787833664.126040:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833664.126158:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6770:x1874679375604864:12345-0@lo:7: Request processed in 6820us (8496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833664.126168:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787833664.129841:0:6770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623e8f00 x1874679375604864/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787833680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833664.129862:0:6770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874679375604864:0@lo:7: 00000004:00080000:1.0:1787833664.129877:0:6770:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787833664.130879:0:6770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874679375604992:0@lo:5: 00000100:00100000:0.0:1787833664.130967:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833664.131036:0:6770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341184240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833664.131737:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375604992 00000100:00100000:2.0:1787833664.131746:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375604992 00000100:00100000:2.0:1787833664.131799:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787833664.131810:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6770:x1874679375604992:12345-0@lo:5: 00002000:00080000:2.0:1787833664.131839:0:6660:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787833664.131849:0:6660:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787833664.132231:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6770:x1874679375604992:12345-0@lo:5: Request processed in 422us (1262us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787833664.132239:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787833664.132285:0:6770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b645904bc00 x1874679375604992/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833664.132302:0:6770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874679375604992:0@lo:5: 00000004:00080000:2.0:1787833664.132316:0:6770:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787833664.132385:0:6770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462314780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874679375605120:0@lo:700: 00000100:00100000:2.0:1787833664.132414:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833664.132433:0:6770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452de5300 going to sleep for 11 seconds 00000100:00100000:2.0:1787833664.132452:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375605120 00000100:00100000:2.0:1787833664.132455:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375605120 00000100:00100000:2.0:1787833664.132478:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833664.132484:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6770:x1874679375605120:12345-0@lo:700: 00000100:00100000:2.0:1787833664.132508:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6667:1874679375605248:0@lo:700: 00000100:00100000:2.0:1787833664.132531:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833664.132549:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452de5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833664.135461:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375605248 00000100:00100000:0.0:1787833664.135474:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375605248 00000100:00100000:0.0:1787833664.135530:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833664.135540:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6667:x1874679375605248:12345-0@lo:700: 40000000:02000000:2.0:1787833664.199280:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787833664.206019:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6667:x1874679375605248:12345-0@lo:700: Request processed in 70474us (73480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833664.206039:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787833664.206153:0:6667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6462315a40 x1874679375605248/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787833680 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833664.206171:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6667:1874679375605248:0@lo:700: 40000000:02000000:2.0:1787833664.206185:0:6667:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787833664.326323:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6770:x1874679375605120:12345-0@lo:700: Request processed in 193828us (193897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833664.326361:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1787833664.326396:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787833664.326409:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1787833664.326458:0:6770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6462314780 x1874679375605120/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787833680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833664.326475:0:6770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462314780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874679375605120:0@lo:700: 00000004:02000040:3.0:1787833664.399612:0:6770:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787833664.404725:0:6770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874679375605376:0@lo:5: 00000100:00100000:3.0:1787833664.404800:0:6770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833664.404925:0:6770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64431e7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833664.411495:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375605376 00000100:00100000:0.0:1787833664.411512:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375605376 00000100:00100000:0.0:1787833664.411644:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787833664.411656:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6770:x1874679375605376:12345-0@lo:5: 00002000:00080000:0.0:1787833664.420815:0:6661:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787833664.420841:0:6661:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787833664.429546:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6770:x1874679375605376:12345-0@lo:5: Request processed in 17884us (24736us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787833664.429565:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787833664.429621:0:6770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b647fa7e580 x1874679375605376/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833680 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833664.429637:0:6770:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787833664.429655:0:6770:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b647fa7e580 x1874679375605376/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833680 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833664.429666:0:6770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6770:1874679375605376:0@lo:5: 00000004:00080000:3.0:1787833664.429680:0:6770:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787833664.828509:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833665.852583:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833666.876471:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833667.901378:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833668.924480:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833669.182522:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375605504:0@lo:13: 00000100:00100000:0.0:1787833669.182601:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833669.183055:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375605504 00000100:00100000:0.0:1787833669.183063:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375605504 00000100:00100000:0.0:1787833669.183121:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833669.183130:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64590483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1874679375605504:12345-0@lo:13: 00002000:00000024:0.0:1787833669.183169:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833669.183219:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64590483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1874679375605504:12345-0@lo:13: Request processed in 90us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833669.183227:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787833669.183250:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833669.183281:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b645904a940 x1874679375605504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833669.183313:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375605504:0@lo:13: 00000100:00100000:0.0:1787833669.184980:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375605760:0@lo:400: 00000100:00100000:0.0:1787833669.185046:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833669.185083:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833669.185088:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375605888:0@lo:400: 00000100:00100000:0.0:1787833669.185114:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833669.185150:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375605760 00000100:00100000:0.0:1787833669.185156:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375605760 00000100:00100000:0.0:1787833669.185203:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375605888 00000100:00100000:0.0:1787833669.185206:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375605888 00000100:00100000:0.0:1787833669.185231:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787833669.185239:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375605760:12345-0@lo:400: 00000100:00100000:0.0:1787833669.185287:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375605760:12345-0@lo:400: Request processed in 49us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833669.185295:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787833669.185309:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833669.185320:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375605888:12345-0@lo:400: 00000100:00100000:0.0:1787833669.185365:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459048b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375605888:12345-0@lo:400: Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833669.186492:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375605632:0@lo:400: 00000100:00100000:3.0:1787833669.186550:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833669.186713:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833669.186756:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375605632 00000100:00100000:0.0:1787833669.187118:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375605632 00000100:00100000:0.0:1787833669.187172:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787833669.187180:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3281:x1874679375605632:12345-0@lo:400: 00000100:00100000:0.0:1787833669.187233:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3281:x1874679375605632:12345-0@lo:400: Request processed in 54us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833669.187249:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787833669.187282:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787833669.187316:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6459049680 x1874679375605888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833669.187331:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375605888:0@lo:400: 00000100:00100000:3.0:1787833669.187560:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375605632:0@lo:400: 00010000:00080000:0.0:1787833669.188301:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b645904b0c0 x1874679375605760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833669.188315:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375605760:0@lo:400: 00000001:02000400:3.0:1787833669.778622:0:7031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:2.0:1787833669.799928:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787833669.948687:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833670.977404:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833671.996779:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833673.027881:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833674.054008:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833674.303907:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375606016:0@lo:13: 00000100:00100000:2.0:1787833674.303989:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833674.309426:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375606016 00000100:00100000:0.0:1787833674.309446:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375606016 00000100:00100000:0.0:1787833674.309524:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833674.309535:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462317840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375606016:12345-0@lo:13: 00002000:00000024:0.0:1787833674.309576:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833674.310793:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462317840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375606016:12345-0@lo:13: Request processed in 1255us (6798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833674.310807:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833674.310842:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375606144:0@lo:400: 00000100:00100000:0.0:1787833674.310928:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787833674.310989:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833674.311141:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375606144 00000100:00100000:3.0:1787833674.311149:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375606144 00000100:00100000:3.0:1787833674.311193:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787833674.311202:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3281:x1874679375606144:12345-0@lo:400: 00000100:00100000:3.0:1787833674.311315:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3281:x1874679375606144:12345-0@lo:400: Request processed in 114us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833674.311322:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1787833674.311721:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6459049680 x1874679375606016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833674.311734:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787833674.311756:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375606016:0@lo:13: 00000100:00100000:0.0:1787833674.312110:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375606144:0@lo:400: 00000100:00100000:3.0:1787833674.333194:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375606272:0@lo:400: 00000100:00100000:3.0:1787833674.333282:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833674.334050:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375606400:0@lo:400: 00000100:00100000:2.0:1787833674.334094:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833674.334150:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375606272 00000100:00100000:2.0:1787833674.334157:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375606272 00000100:00100000:2.0:1787833674.334202:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375606400 00000100:00100000:2.0:1787833674.334205:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375606400 00000100:00100000:2.0:1787833674.334244:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833674.334253:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375606272:12345-0@lo:400: 00000100:00080000:0.0:1787833674.337147:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833674.337180:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787833674.337212:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787833674.340581:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375606272:12345-0@lo:400: Request processed in 6317us (7287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833674.340596:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833674.340639:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833674.340658:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375606400:12345-0@lo:400: 00000100:00100000:2.0:1787833674.340813:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375606400:12345-0@lo:400: Request processed in 166us (6718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833674.340820:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787833674.346432:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623e8b40 x1874679375606272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833674.346472:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375606272:0@lo:400: 00010000:00080000:1.0:1787833674.346926:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623e8780 x1874679375606400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833674.346937:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375606400:0@lo:400: 00010000:00010000:0.0:1787833675.068456:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833676.098805:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833677.119072:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833678.142109:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833679.171664:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833679.422288:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833679.422315:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375606528:0@lo:13: 00000100:00100000:0.0:1787833679.422413:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833679.422471:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375606528 00000100:00100000:0.0:1787833679.422479:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375606528 00000100:00100000:0.0:1787833679.422529:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787833679.422537:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375606528:12345-0@lo:13: 00002000:00000024:0.0:1787833679.422571:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833679.422609:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375606528:12345-0@lo:13: Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833679.422616:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787833679.422635:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833679.422659:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6459048000 x1874679375606528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833679.422678:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375606528:0@lo:13: 00000100:00100000:3.0:1787833679.426295:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833679.426320:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375606656:0@lo:400: 00000100:00100000:3.0:1787833679.426405:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833679.426459:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375606656 00000100:00100000:3.0:1787833679.426466:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375606656 00000100:00100000:3.0:1787833679.426511:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787833679.426519:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3280:x1874679375606656:12345-0@lo:400: 00000100:00100000:3.0:1787833679.426566:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3280:x1874679375606656:12345-0@lo:400: Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833679.426573:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787833679.426619:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375606656:0@lo:400: 00000100:00100000:3.0:1787833679.426655:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375606784:0@lo:400: 00000100:00100000:3.0:1787833679.426680:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833679.426722:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833679.426728:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375606912:0@lo:400: 00000100:00100000:3.0:1787833679.426747:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833679.426890:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375606784 00000100:00100000:2.0:1787833679.426894:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375606784 00000100:00100000:2.0:1787833679.426922:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375606912 00000100:00100000:2.0:1787833679.426925:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375606912 00000100:00100000:2.0:1787833679.426961:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787833679.426968:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375606784:12345-0@lo:400: 00000100:00100000:2.0:1787833679.427011:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375606784:12345-0@lo:400: Request processed in 44us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833679.427017:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787833679.427029:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833679.427036:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375606912:12345-0@lo:400: 00000100:00100000:2.0:1787833679.427062:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375606912:12345-0@lo:400: Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833679.427067:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787833679.427100:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b647fa7ed00 x1874679375606912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833679.427112:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375606912:0@lo:400: 00010000:00080000:2.0:1787833679.427122:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b647fa7e1c0 x1874679375606784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833679.427129:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375606784:0@lo:400: 00000100:00080000:0.0:1787833679.429326:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787833680.190554:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833681.212680:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833682.236517:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833683.262886:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787833683.280373:0:7609:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787833683.280378:0:7609:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787833683.280480:0:7609:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b647fa63000 00000020:01000004:3.0:1787833683.280496:0:7609:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787833683.280510:0:7609:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787833683.280524:0:7609:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b6452f2ced8) 00000020:00000080:3.0:1787833683.280541:0:7609:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787833683.305439:0:7609:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787833683.305684:0:7609:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787833683.343412:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787833683.351241:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787833683.351279:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787833683.351336:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787833683.351398:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787833683.352967:0:7609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787833683.352985:0:7609:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787833683.353017:0:7609:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bdb54ee5e774bbe 00000020:01000004:2.0:1787833683.353027:0:7609:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787833683.353052:0:7609:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787833683.353055:0:7609:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787833683.353062:0:7609:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787833683.353088:0:7609:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787833683.353092:0:7609:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787833683.388037:0:7609:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787833683.388078:0:7609:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.115@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787833683.388086:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787833683.388088:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833683.388089:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833683.388090:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833683.388091:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833683.388092:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833683.388093:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833683.388095:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787833683.388096:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787833683.388098:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833683.388099:0:7609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787833683.388104:0:7609:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787833683.388106:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787833683.388107:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833683.388108:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833683.388109:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833683.388110:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833683.388111:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833683.388111:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833683.388112:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787833683.388113:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787833683.388114:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833683.388115:0:7609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787833683.388155:0:7609:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787833683.388181:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375607040:0@lo:253: 00000100:00100000:3.0:1787833683.388266:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833683.394716:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375607040 00000100:00100000:0.0:1787833683.394746:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375607040 00000100:00100000:0.0:1787833683.403182:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787833683.403208:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:7609:x1874679375607040:12345-0@lo:253: 20000000:01000000:0.0:1787833683.403273:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787833683.403278:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787833683.403289:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787833683.403293:0:5810:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787833683.404640:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833683.405201:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787833683.405219:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787833683.405262:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787833683.405271:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787833683.405301:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787833683.405381:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787833683.407332:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787833683.407383:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:0.0:1787833683.407388:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:0.0:1787833683.407425:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787833683.407431:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787833683.407480:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787833683.407489:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:0.0:1787833683.407521:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787833683.407532:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787833683.407560:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787833683.407606:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787833683.408410:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1787833683.408431:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:0.0:1787833683.408433:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:0.0:1787833683.408465:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1787833683.408471:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787833683.408497:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1787833683.408503:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:0.0:1787833683.408527:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1787833683.408533:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787833683.408575:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1787833683.408612:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1787833683.408628:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787833683.408638:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787833683.408645:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787833683.408647:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787833683.408649:0:5810:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787833683.408663:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787833683.408666:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787833683.408703:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787833683.408706:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000100:00100000:3.0:1787833683.415944:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e480 going to sleep for 11 seconds 20000000:01000000:0.0:1787833683.424026:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787833683.424122:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787833683.424149:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787833683.424501:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787833683.424539:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787833683.424586:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787833683.424599:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787833683.424601:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787833683.433830:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787833683.433933:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787833683.434000:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787833683.434407:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787833683.434453:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787833683.434491:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787833683.434505:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787833683.434508:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787833683.435511:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787833683.435572:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787833683.435625:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787833683.435939:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787833683.435962:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787833683.435999:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787833683.436012:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787833683.436014:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787833683.436736:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787833683.444245:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787833683.444285:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787833683.444898:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1787833683.444925:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787833683.444948:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.444969:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b0f expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.444976:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b39 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.444981:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b63 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.445003:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b7f expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.445011:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774ba9 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.445019:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.445059:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774ba9 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.445073:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774ba9 expref: 16 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.445088:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607168:0@lo:104: 00000100:00100000:1.0:1787833683.445157:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833683.445254:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774b7f expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.445263:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b7f expref: 16 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.445270:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607296:0@lo:104: 00000100:00100000:1.0:1787833683.445293:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833683.452365:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774b63 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.452384:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b63 expref: 16 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.452417:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607424:0@lo:104: 00000100:00100000:1.0:1787833683.452481:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833683.457760:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375607168 00000100:00100000:0.0:1787833683.457790:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375607168 00000100:00100000:0.0:1787833683.457860:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375607296 00000100:00100000:0.0:1787833683.457864:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375607296 00000100:00100000:0.0:1787833683.457884:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787833683.457894:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:5810:x1874679375607168:12345-0@lo:104: 00010000:00010000:0.0:1787833683.457914:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458015:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833683.458036:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:5810:x1874679375607168:12345-0@lo:104: Request processed in 144us (12879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833683.458043:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787833683.458061:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787833683.458068:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5810:x1874679375607296:12345-0@lo:104: 00010000:00010000:0.0:1787833683.458077:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458111:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787833683.458115:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5810:x1874679375607296:12345-0@lo:104: Request processed in 49us (12823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833683.458119:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787833683.458147:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787833683.458152:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458157:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031400 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833683.458160:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458166:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833683.458173:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833683.458178:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787833683.458210:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458226:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833683.458244:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458249:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6440031400/0x2bdb54ee5e774ba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774bb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458257:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833683.458259:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458263:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82600 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833683.458264:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458269:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833683.458272:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833683.458275:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787833683.458284:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458287:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833683.458290:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458293:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458305:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833683.458306:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833683.458307:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833683.458323:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375607552:0@lo:103: 00000100:00100000:0.0:1787833683.458372:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833683.458400:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833683.458404:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375607680:0@lo:103: 00000100:00100000:0.0:1787833683.458416:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833683.458435:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375607552 00000100:00100000:0.0:1787833683.458438:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375607552 00010000:00010000:0.0:1787833683.458454:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774ba9 expref: 17 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833683.458473:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375607680 00000100:00100000:0.0:1787833683.458476:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375607680 00010000:00010000:0.0:1787833683.458486:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b7f expref: 18 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833683.458497:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833683.458503:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459048780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3280:x1874679375607552:12345-0@lo:103: 00010000:00010000:0.0:1787833683.458513:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833683.458518:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774ba9 expref: 18 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458526:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774ba9 expref: 18 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458543:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833683.458568:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459048780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3280:x1874679375607552:12345-0@lo:103: Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833683.458573:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787833683.458582:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787833683.458585:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64590492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:3280:x1874679375607680:12345-0@lo:103: 00010000:00010000:0.0:1787833683.458590:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833683.458593:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b7f expref: 17 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458599:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b7f expref: 17 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.458605:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833683.458617:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64590492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:3280:x1874679375607680:12345-0@lo:103: Request processed in 32us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833683.458621:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787833683.458646:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375607680:0@lo:103: 00000100:00100000:0.0:1787833683.458651:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375607552:0@lo:103: 00010000:00010000:3.0:1787833683.458713:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833683.458980:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774b39 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.458992:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b39 expref: 16 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.459002:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607808:0@lo:104: 00000100:00100000:1.0:1787833683.459027:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833683.459044:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774b0f expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.459053:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b0f expref: 16 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.459061:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607936:0@lo:104: 00000100:00100000:1.0:1787833683.459095:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.459105:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341184600 going to sleep for 11 seconds 00010000:00010000:1.0:1787833683.459115:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774bb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774ba9 expref: 16 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.459122:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607168:0@lo:104: 00010000:00010000:1.0:1787833683.459128:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774b86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774b7f expref: 15 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.459133:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607296:0@lo:104: 00000100:00100000:3.0:1787833683.459179:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375607424 00000100:00100000:3.0:1787833683.459184:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375607424 00000100:00100000:3.0:1787833683.459203:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375607808 00000100:00100000:3.0:1787833683.459205:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375607808 00000100:00100000:3.0:1787833683.459213:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375607936 00000100:00100000:3.0:1787833683.459216:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375607936 00000100:00100000:3.0:1787833683.459227:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833683.459232:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:5810:x1874679375607424:12345-0@lo:104: 00010000:00010000:3.0:1787833683.459246:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459284:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787833683.459287:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:5810:x1874679375607424:12345-0@lo:104: Request processed in 57us (6808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.459292:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833683.459303:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787833683.459306:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:5810:x1874679375607808:12345-0@lo:104: 00010000:00010000:3.0:1787833683.459311:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459328:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787833683.459331:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:5810:x1874679375607808:12345-0@lo:104: Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.459335:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787833683.459363:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787833683.459367:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342375680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5810:x1874679375607936:12345-0@lo:104: 00010000:00010000:3.0:1787833683.459371:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459391:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787833683.459394:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342375680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5810:x1874679375607936:12345-0@lo:104: Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.459398:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787833683.459407:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787833683.459410:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459419:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82c00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:3.0:1787833683.459422:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459427:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833683.459431:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833683.459434:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833683.459450:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459456:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833683.459473:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459479:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82c00/0x2bdb54ee5e774b63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459493:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833683.459495:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459501:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82e00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:3.0:1787833683.459504:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459520:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833683.459524:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833683.459528:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833683.459538:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459541:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833683.459544:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459548:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82e00/0x2bdb54ee5e774b39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b40 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459554:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833683.459556:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459559:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82400 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:3.0:1787833683.459561:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459565:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833683.459568:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833683.459575:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833683.459583:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459587:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833683.459593:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459597:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b16 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.459606:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833683.459607:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833683.459608:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833683.459658:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833683.459680:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375608192:0@lo:103: 00000100:00100000:1.0:1787833683.459700:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.459715:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833683.459718:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375608064:0@lo:103: 00000100:00100000:1.0:1787833683.459729:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.459748:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375608192 00000100:00100000:1.0:1787833683.459752:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375608192 00010000:00010000:1.0:1787833683.459768:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b39 expref: 15 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.459795:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375608064 00000100:00100000:1.0:1787833683.459798:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375608064 00010000:00010000:1.0:1787833683.459808:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b63 expref: 16 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.459820:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787833683.459825:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342374f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3283:x1874679375608192:12345-0@lo:103: 00010000:00010000:1.0:1787833683.459832:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833683.459836:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b39 expref: 16 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.459845:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b39 expref: 16 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.459856:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833683.459882:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342374f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3283:x1874679375608192:12345-0@lo:103: Request processed in 57us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833683.459888:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787833683.459900:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787833683.459906:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b63423761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:3283:x1874679375608064:12345-0@lo:103: 00010000:00010000:1.0:1787833683.459918:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833683.459922:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b63 expref: 15 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.459928:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b63 expref: 15 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.459935:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833683.459950:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b63423761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:3283:x1874679375608064:12345-0@lo:103: Request processed in 46us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833683.459954:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787833683.459976:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375608064:0@lo:103: 00000100:00100000:1.0:1787833683.459981:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375608192:0@lo:103: 00010000:00010000:1.0:1787833683.460006:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e774b6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774b63 expref: 14 pid: 5807 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.460015:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607424:0@lo:104: 00010000:00010000:1.0:1787833683.460024:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774b39 expref: 13 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.460031:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607808:0@lo:104: 00000100:00100000:1.0:1787833683.460038:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1874679375607936:0@lo:104: 00010000:00010000:1.0:1787833683.460061:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.460799:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833683.460820:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375608320:0@lo:103: 00000100:00100000:0.0:1787833683.460858:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.460938:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375608320 00000100:00100000:1.0:1787833683.460943:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375608320 00010000:00010000:1.0:1787833683.460969:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b0f expref: 13 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.460995:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787833683.461001:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:3280:x1874679375608320:12345-0@lo:103: 00010000:00010000:1.0:1787833683.461010:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833683.461014:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b0f expref: 13 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461024:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b0f expref: 13 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461036:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440031c00/0x2bdb54ee5e774b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774b0f expref: 13 pid: 5809 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461048:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461057:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461071:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461078:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461086:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461093:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461104:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833683.461107:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461113:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461130:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.461137:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833683.461162:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3280:x1874679375608320:12345-0@lo:103: Request processed in 162us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833683.461168:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787833683.461199:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375608320:0@lo:103: 00010000:00010000:3.0:1787833683.461244:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.461250:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.461254:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774bc5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787833683.461263:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787833683.529542:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375607040:0@lo:253: 00000100:00100000:1.0:1787833683.529542:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:7609:x1874679375607040:12345-0@lo:253: Request processed in 126341us (141269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833683.529556:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 10000000:01000000:3.0:1787833683.529561:0:7609:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787833683.529564:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787833683.529565:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833683.529567:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833683.529568:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787833683.529584:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833683.529585:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833683.529587:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833683.529589:0:7609:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787833683.529590:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833683.529591:0:7609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787833683.529611:0:7609:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b647fa63000 from lustre-OST0001 10000000:01000000:3.0:1787833683.529640:0:7609:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787833683.529642:0:7609:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787833683.529650:0:7609:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6443fdced8 local copy 10000000:01000000:3.0:1787833683.529654:0:7609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787833683.529688:0:7609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.529700:0:7609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.529709:0:7609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833683.529730:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375608448:0@lo:101: 00000100:00100000:3.0:1787833683.529788:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.529847:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833683.529977:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375608448 00000100:00100000:0.0:1787833683.529990:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375608448 00000100:00100000:0.0:1787833683.530031:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787833683.530040:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:7609:x1874679375608448:12345-0@lo:101: 00010000:00010000:0.0:1787833683.530053:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833683.530066:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440031400/0x2bdb54ee5e774bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774bcc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.530108:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440031400/0x2bdb54ee5e774bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774bcc expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.530118:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440031400/0x2bdb54ee5e774bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774bcc expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.530128:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031400, rc 0) 00000100:00100000:0.0:1787833683.530169:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375608448:12345-0@lo:101: Request processed in 131us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833683.530176:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787833683.530253:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375608448:0@lo:101: 00010000:00010000:3.0:1787833683.530266:0:7609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.530276:0:7609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833683.530418:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375608576:0@lo:501: 00000100:00100000:3.0:1787833683.530442:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.530479:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833683.530538:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375608576 00000100:00100000:1.0:1787833683.530543:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375608576 00000100:00100000:1.0:1787833683.530573:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787833683.530579:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375608576:12345-0@lo:501: 00000100:00100000:1.0:1787833683.530958:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375608576:12345-0@lo:501: Request processed in 378us (514us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787833683.530966:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787833683.531082:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375608576:0@lo:501: 10000000:01000000:3.0:1787833683.531095:0:7609:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787833683.531119:0:7609:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787833683.531125:0:7609:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.531132:0:7609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.531137:0:7609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.531153:0:7609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787833683.531181:0:7609:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b647fa63000 00010000:00010000:0.0:1787833683.531183:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787833683.531186:0:7609:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787833683.531189:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833683.531190:0:7609:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787833683.531193:0:7609:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787833683.531196:0:7609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 00010000:00010000:0.0:1787833683.531197:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc1e04c20) 10000000:01000000:3.0:1787833683.531199:0:7609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 10000000:00010000:0.0:1787833683.531200:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.531208:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.531213:0:7609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.531219:0:7609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833683.531221:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833683.531227:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833683.531229:0:7609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833683.531241:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375608704:0@lo:101: 00010000:00010000:0.0:1787833683.531244:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.531250:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787833683.531273:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.531318:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375608832:0@lo:103: 00000100:00100000:1.0:1787833683.531367:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.531399:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b644395cd80 going to sleep for 11 seconds 00010000:00010000:0.0:1787833683.531439:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.531446:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bdb54ee5e774bd3 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.531459:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833683.531461:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833683.531463:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833683.531503:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375608832 00000100:00100000:1.0:1787833683.531507:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375608832 00000100:00100000:1.0:1787833683.531575:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787833683.531583:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3281:x1874679375608832:12345-0@lo:103: 00010000:00010000:1.0:1787833683.531592:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833683.531605:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440031400/0x2bdb54ee5e774bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774bcc expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.531619:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833683.531648:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:3281:x1874679375608832:12345-0@lo:103: Request processed in 67us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833683.531655:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787833683.531716:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375608832:0@lo:103: 00000100:00100000:2.0:1787833683.531957:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375608704 00000100:00100000:2.0:1787833683.531961:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375608704 00000100:00100000:2.0:1787833683.531999:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787833683.532005:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+11:7609:x1874679375608704:12345-0@lo:101: 00010000:00010000:2.0:1787833683.532014:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833683.532026:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774bda expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833683.532042:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774bda expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833683.532050:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774bda expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833683.532054:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83c00, rc 0) 00000100:00100000:2.0:1787833683.532087:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375608704:12345-0@lo:101: Request processed in 82us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.532093:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787833683.532113:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375608704:0@lo:101: 00010000:00010000:1.0:1787833683.532125:0:7609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.532134:0:7609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.532203:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375608960:0@lo:501: 00000100:00100000:1.0:1787833683.532229:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.532253:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b63411846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833683.532299:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375608960 00000100:00100000:3.0:1787833683.532304:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375608960 00000100:00100000:3.0:1787833683.532354:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787833683.532361:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375608960:12345-0@lo:501: 00000100:00100000:3.0:1787833683.532533:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375608960:12345-0@lo:501: Request processed in 172us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.532540:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787833683.532554:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375608960:0@lo:501: 00000100:00100000:1.0:1787833683.532579:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609088:0@lo:503: 00000100:00100000:1.0:1787833683.532617:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.532644:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b63411846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833683.532694:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375609088 00000100:00100000:2.0:1787833683.532697:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375609088 00000100:00100000:2.0:1787833683.532821:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787833683.532889:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375609088:12345-0@lo:503: 00000100:00100000:2.0:1787833683.533049:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375609088:12345-0@lo:503: Request processed in 162us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.533056:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787833683.533065:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609088:0@lo:503: 00000040:00080000:1.0:1787833683.533432:0:7609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787833683.533487:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609216:0@lo:502: 00000100:00100000:1.0:1787833683.533525:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.533556:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451941cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833683.533882:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375609216 00000100:00100000:3.0:1787833683.533887:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375609216 00000100:00100000:3.0:1787833683.533905:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787833683.533909:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375609216:12345-0@lo:502: 00000100:00100000:3.0:1787833683.534068:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375609216:12345-0@lo:502: Request processed in 156us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.534075:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787833683.534163:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609216:0@lo:502: 00000040:00080000:1.0:1787833683.534510:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787833683.534561:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787833683.534595:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787833683.534643:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787833683.534680:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787833683.534711:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787833683.534737:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609344:0@lo:502: 00000100:00100000:1.0:1787833683.534801:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.534832:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451941cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833683.535250:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375609344 00000100:00100000:3.0:1787833683.535255:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375609344 00000100:00100000:3.0:1787833683.535287:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787833683.535294:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375609344:12345-0@lo:502: 00000100:00100000:3.0:1787833683.535581:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375609344:12345-0@lo:502: Request processed in 286us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.535589:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787833683.535607:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609344:0@lo:502: 00000040:00080000:1.0:1787833683.535704:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787833683.535716:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787833683.536642:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787833683.536653:0:7616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787833683.536659:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833683.536661:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787833683.536665:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787833683.536723:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b6341b6ced8) 00000020:00000080:1.0:1787833683.536764:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787833683.536782:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787833683.536858:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b647fa63000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787833683.536864:0:7616:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787833683.536871:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bdb54ee5e774bef 00010000:00010000:1.0:1787833683.540464:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787833683.540849:0:7616:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787833683.546713:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787833683.547062:0:7616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787833683.563186:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787833683.566470:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787833683.574003:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787833683.574017:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833683.574023:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833683.574026:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787833683.574030:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833683.574043:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833683.574044:0:7616:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787833683.574047:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787833683.574048:0:7616:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787833683.574113:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833683.574117:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833683.574118:0:7616:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787833683.574121:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787833683.574207:0:7609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787833683.574231:0:7609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787833683.574265:0:7609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.574277:0:7609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833683.574285:0:7609:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b647fa63000 from 1 10000000:01000000:1.0:1787833683.574288:0:7609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833683.574326:0:7609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.574334:0:7609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.574367:0:7609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.574394:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609472:0@lo:101: 00000100:00100000:1.0:1787833683.574472:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.574575:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451941180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833683.575378:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375609472 00000100:00100000:2.0:1787833683.575387:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375609472 00000100:00100000:2.0:1787833683.575444:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787833683.575454:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:7609:x1874679375609472:12345-0@lo:101: 00010000:00010000:2.0:1787833683.575469:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833683.575485:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774bf6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833683.575508:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774bf6 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833683.575519:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774bf6 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833683.575528:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83600, rc 0) 00000100:00100000:2.0:1787833683.575681:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375609472:12345-0@lo:101: Request processed in 229us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.575689:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787833683.575910:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609472:0@lo:101: 00010000:00010000:3.0:1787833683.575924:0:7609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.575933:0:7609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833683.576056:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609600:0@lo:501: 00000100:00100000:3.0:1787833683.576084:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.576121:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601b1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833683.576165:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375609600 00000100:00100000:2.0:1787833683.576183:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375609600 00000100:00100000:2.0:1787833683.576214:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787833683.576221:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375609600:12345-0@lo:501: 00000100:00100000:2.0:1787833683.576479:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375609600:12345-0@lo:501: Request processed in 257us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.576486:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787833683.577037:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609600:0@lo:501: 00000100:00100000:3.0:1787833683.577067:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609728:0@lo:503: 00000100:00100000:3.0:1787833683.577105:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.577133:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601b1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833683.577165:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375609728 00000100:00100000:2.0:1787833683.577169:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375609728 00000100:00100000:2.0:1787833683.577204:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787833683.577212:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375609728:12345-0@lo:503: 00000100:00100000:2.0:1787833683.577535:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375609728:12345-0@lo:503: Request processed in 324us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.577542:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787833683.577845:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609728:0@lo:503: 00000040:00080000:3.0:1787833683.579125:0:7609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787833683.579309:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609856:0@lo:502: 00000100:00100000:3.0:1787833683.579890:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.579926:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601b1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833683.579941:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375609856 00000100:00100000:2.0:1787833683.579948:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375609856 00000100:00100000:2.0:1787833683.580003:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787833683.580011:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375609856:12345-0@lo:502: 00000100:00100000:2.0:1787833683.580260:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375609856:12345-0@lo:502: Request processed in 249us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.580269:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787833683.580292:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609856:0@lo:502: 00000040:00080000:3.0:1787833683.580564:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787833683.580620:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787833683.580647:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609984:0@lo:502: 00000100:00100000:3.0:1787833683.580681:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.580700:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601b1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833683.580726:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375609984 00000100:00100000:2.0:1787833683.580739:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375609984 00000100:00100000:2.0:1787833683.580888:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787833683.580897:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375609984:12345-0@lo:502: 00000100:00100000:2.0:1787833683.581267:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375609984:12345-0@lo:502: Request processed in 370us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.581275:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787833683.581381:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375609984:0@lo:502: 00000040:00080000:3.0:1787833683.582061:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787833683.582074:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787833683.584719:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833683.584744:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833683.584746:0:7619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787833683.584882:0:7619:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b647fa63000 00000020:00000080:2.0:1787833683.584886:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787833683.584922:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833683.584992:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833683.584994:0:7619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787833683.584998:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787833683.585164:0:7609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787833683.585190:0:7609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833683.585211:0:7609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.585223:0:7609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833683.585272:0:7609:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787833683.585275:0:7609:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b647fa63000 10000000:01000000:3.0:1787833683.585279:0:7609:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b647fa63000 10000000:01000000:3.0:1787833683.585283:0:7609:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787833683.585288:0:7609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b647fa63000 from 1 10000000:01000000:3.0:1787833683.585291:0:7609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787833683.585332:0:7609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.585380:0:7609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833683.585393:0:7609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833683.585428:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610112:0@lo:101: 00000100:00100000:3.0:1787833683.585508:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.585574:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601b1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787833683.589842:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375610112 00000100:00100000:1.0:1787833683.589857:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375610112 00000100:00100000:1.0:1787833683.589916:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787833683.589925:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375610112:12345-0@lo:101: 00010000:00010000:1.0:1787833683.589943:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833683.589965:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774c04 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.590009:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c04 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.590021:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c04 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.590030:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199000, rc 0) 00000100:00100000:1.0:1787833683.590114:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375610112:12345-0@lo:101: Request processed in 190us (4606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833683.590122:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787833683.590181:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610112:0@lo:101: 00010000:00010000:1.0:1787833683.590199:0:7609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.590208:0:7609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.590364:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b63423752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610240:0@lo:501: 00000100:00100000:1.0:1787833683.590408:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.590457:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451941180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833683.590671:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375610240 00000100:00100000:2.0:1787833683.590686:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375610240 00000100:00100000:2.0:1787833683.590720:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787833683.590728:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375610240:12345-0@lo:501: 00000100:00100000:2.0:1787833683.591195:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375610240:12345-0@lo:501: Request processed in 467us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.591204:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787833683.592764:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b63423752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610240:0@lo:501: 00000100:00100000:1.0:1787833683.592838:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b63423752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610368:0@lo:503: 00000100:00100000:1.0:1787833683.592907:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.592952:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451941180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833683.593011:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375610368 00000100:00100000:2.0:1787833683.593018:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375610368 00000100:00100000:2.0:1787833683.593067:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787833683.593076:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375610368:12345-0@lo:503: 00000100:00100000:2.0:1787833683.593380:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375610368:12345-0@lo:503: Request processed in 304us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.593388:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787833683.594123:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b63423752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610368:0@lo:503: 00000040:00080000:0.0:1787833683.594723:0:7609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787833683.594805:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459049a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610496:0@lo:502: 00000100:00100000:0.0:1787833683.595153:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833683.595206:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647424f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833683.596222:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375610496 00000100:00100000:2.0:1787833683.596229:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375610496 00000100:00100000:2.0:1787833683.596292:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787833683.596302:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375610496:12345-0@lo:502: 00000100:00100000:2.0:1787833683.597159:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375610496:12345-0@lo:502: Request processed in 855us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.597188:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787833683.597959:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459049a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610496:0@lo:502: 00000040:00080000:0.0:1787833683.599669:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787833683.599756:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787833683.599803:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787833683.600124:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787833683.600147:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787833683.600225:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787833683.600248:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787833683.600265:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787833683.600289:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787833683.600307:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787833683.600428:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787833683.600527:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787833683.600547:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787833683.600571:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787833683.600616:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787833683.600665:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787833683.600694:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787833683.601065:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787833683.601088:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787833683.601104:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787833683.601146:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787833683.601685:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787833683.601813:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787833683.605321:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787833683.605437:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787833683.605460:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787833683.605490:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787833683.605507:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787833683.605523:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787833683.605546:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787833683.605569:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787833683.605600:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787833683.605633:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787833683.605682:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787833683.605708:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787833683.605734:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787833683.605767:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787833683.605828:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459049a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610624:0@lo:502: 00000100:00100000:0.0:1787833683.605910:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833683.605953:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647424f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833683.605965:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375610624 00000100:00100000:1.0:1787833683.605973:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375610624 00000100:00100000:1.0:1787833683.606032:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787833683.606041:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375610624:12345-0@lo:502: 00000100:00100000:1.0:1787833683.606267:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375610624:12345-0@lo:502: Request processed in 226us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833683.606275:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787833683.606749:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459049a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375610624:0@lo:502: 00000040:00080000:2.0:1787833683.606869:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787833683.606879:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787833683.607889:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787833683.607904:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b6452f29a48) 00000020:00000080:3.0:1787833683.607936:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787833683.608034:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b647fa63000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787833683.608039:0:7621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b647fa63000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787833683.608042:0:7621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b647fa63000 3 00010000:00080000:3.0:1787833683.608073:0:7621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6341339000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.115@tcp at head 00010000:00010000:3.0:1787833683.611269:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787833683.611698:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787833683.611750:0:7621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787833683.611779:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2bdb54ee5e774c19 00000100:00080000:3.0:1787833683.611792:0:7621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787833683.611798:0:7621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b6341339000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787833683.611831:0:7621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b647fa7e580 x1874679375610752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787833683.611886:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1874679375610752:0@lo:38: 00000100:00100000:2.0:1787833683.611975:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787833683.612039:0:7621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787833683.612400:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375611136:0@lo:400: 00000100:00100000:0.0:1787833683.612439:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833683.612493:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375611136 00000100:00100000:0.0:1787833683.612501:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375611136 00000100:00100000:0.0:1787833683.612551:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833683.612561:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375611136:12345-0@lo:400: 00000100:00100000:0.0:1787833683.612625:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375611136:12345-0@lo:400: Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833683.612633:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787833683.612653:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833683.612683:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b645904a940 x1874679375611136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833683.612698:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375611136:0@lo:400: 00000100:00100000:3.0:1787833683.613819:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375610880:0@lo:400: 00000100:00100000:3.0:1787833683.613872:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.613907:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833683.613914:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375611008:0@lo:400: 00000100:00100000:3.0:1787833683.613950:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833683.613986:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375610752 00000100:00100000:3.0:1787833683.613991:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375610752 00000100:00100000:3.0:1787833683.614026:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375610880 00000100:00100000:3.0:1787833683.614029:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375610880 00000100:00100000:3.0:1787833683.614049:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375611008 00000100:00100000:3.0:1787833683.614051:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375611008 00000100:00100000:3.0:1787833683.614072:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787833683.614080:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375610880:12345-0@lo:400: 00000100:00100000:3.0:1787833683.614126:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375610880:12345-0@lo:400: Request processed in 46us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.614133:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787833683.614148:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787833683.614154:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375611008:12345-0@lo:400: 00000100:00100000:3.0:1787833683.614181:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375611008:12345-0@lo:400: Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.614187:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787833683.614198:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787833683.614201:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1874679375610752:12345-0@lo:38: 00010000:00080000:3.0:1787833683.614221:0:5817:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:3.0:1787833683.614256:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2bdb54ee5e774c20 00000004:00100000:3.0:1787833683.614273:0:5817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787833683.614273:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833683.614304:0:5817:0:(import.c:65:import_set_state_nolock()) ffff9b634133a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833683.614715:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874679375610752:12345-0@lo:38: Request processed in 510us (2738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.614722:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787833683.615022:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b647fa7e580 x1874679375610752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833683.615035:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787833683.615045:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787833683.615053:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787833683.615059:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787833683.615061:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b6341339000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787833683.615067:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1874679375610752:0@lo:38: 00010000:00080000:3.0:1787833683.615146:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b645904b0c0 x1874679375611008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833683.615156:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375611008:0@lo:400: 00010000:00080000:3.0:1787833683.615167:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6459049680 x1874679375610880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833683.615184:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459049680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375610880:0@lo:400: 00000100:00100000:0.0:1787833683.615308:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1874679375611264:0@lo:901: 00000040:00080000:3.0:1787833683.615367:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787833683.615786:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833683.615812:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647424f3c0 going to sleep for 11 seconds 00000020:01000000:2.0:1787833683.616022:0:7609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787833683.616052:0:7609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787833683.616074:0:7609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833683.616085:0:7609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787833683.616128:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787833683.616131:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787833683.616132:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833683.616133:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833683.616134:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833683.616141:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833683.616142:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833683.616144:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833683.616145:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833683.616147:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833683.616148:0:7609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787833683.616151:0:7609:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787833683.616154:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787833683.616155:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787833683.616156:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833683.616157:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833683.616158:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833683.616159:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833683.616160:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833683.616161:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787833683.616161:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787833683.616163:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833683.616163:0:7609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787833683.616179:0:7609:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787833683.616188:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375611392:0@lo:253: 00000100:00100000:2.0:1787833683.616236:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833683.616271:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442f5b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833683.616280:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375611392 00000100:00100000:0.0:1787833683.616285:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375611392 00000100:00100000:0.0:1787833683.616335:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787833683.616359:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:7609:x1874679375611392:12345-0@lo:253: 20000000:01000000:0.0:1787833683.616388:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787833683.616401:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787833683.616707:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375611264 00000100:00100000:3.0:1787833683.616712:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375611264 00000100:00100000:3.0:1787833683.617051:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787833683.617060:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1874679375611264:12345-0@lo:901: 00000100:00100000:3.0:1787833683.617386:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459048f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1874679375611264:12345-0@lo:901: Request processed in 328us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833683.617394:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787833683.617415:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787833683.619458:0:7622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b645904a940 x1874679375611264/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787833699 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833683.619476:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1874679375611264:0@lo:901: 20000000:01000000:0.0:1787833683.661373:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787833683.661386:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787833683.661487:0:5831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787833683.661492:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787833683.661516:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.661537:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b71 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.661545:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.661581:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774b71 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833683.661595:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b71 expref: 14 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833683.661608:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342377480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874679375611520:0@lo:104: 00000100:00100000:1.0:1787833683.661674:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833683.661723:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b646dda3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833683.661903:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375611520 00000100:00100000:0.0:1787833683.661910:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375611520 00000100:00100000:0.0:1787833683.661968:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787833683.661976:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5831:x1874679375611520:12345-0@lo:104: 00010000:00010000:0.0:1787833683.662005:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662076:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833683.662083:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:5831:x1874679375611520:12345-0@lo:104: Request processed in 107us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833683.662090:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787833683.662180:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833683.662186:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662194:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82a00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833683.662198:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662207:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833683.662214:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833683.662220:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787833683.662246:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662253:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833683.662269:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662276:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82a00/0x2bdb54ee5e774b71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662302:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833683.662304:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833683.662305:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833683.662325:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375611648:0@lo:103: 00000100:00100000:0.0:1787833683.662395:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833683.662434:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375611648 00000100:00100000:0.0:1787833683.662438:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375611648 00010000:00010000:0.0:1787833683.662456:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b71 expref: 15 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833683.662477:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787833683.662484:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:3281:x1874679375611648:12345-0@lo:103: 00010000:00010000:0.0:1787833683.662494:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833683.662498:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b71 expref: 15 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662509:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b71 expref: 15 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662525:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662533:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787833683.662546:0:5801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009421334s 00010000:00010000:0.0:1787833683.662551:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662568:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662575:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662582:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662588:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198e00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833683.662591:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662599:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662608:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.662618:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833683.662649:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:3281:x1874679375611648:12345-0@lo:103: Request processed in 165us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833683.662655:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787833683.662712:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375611648:0@lo:103: 00010000:00010000:0.0:1787833683.663031:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774b78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774b71 expref: 14 pid: 5810 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833683.663046:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342377480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1874679375611520:0@lo:104: 00010000:00010000:0.0:1787833683.663060:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.663075:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.663082:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833683.663089:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833683.670266:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:7609:x1874679375611392:12345-0@lo:253: Request processed in 53897us (54019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833683.670287:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787833683.670621:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b866019b-748d-45d1-b7c8-b21ed54e15f4:7609:1874679375611392:0@lo:253: 10000000:01000000:3.0:1787833683.670637:0:7609:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787833683.670640:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787833683.670642:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833683.670643:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833683.670644:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833683.670645:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833683.670646:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833683.670648:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833683.670649:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787833683.670650:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787833683.670652:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833683.670653:0:7609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787833683.670674:0:7609:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787833683.676274:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833683.676515:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833683.676693:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833683.677109:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833683.677428:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833683.678250:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787833683.679480:0:7609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787833683.972010:0:7609:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787833683.972018:0:7609:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787833683.972062:0:7609:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787833683.972119:0:7609:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787833683.972134:0:7609:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787833683.972162:0:7609:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787833684.290198:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833684.540683:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833684.540717:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375611776:0@lo:13: 00000100:00100000:1.0:1787833684.540807:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833684.541069:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375611776 00000100:00100000:0.0:1787833684.541076:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375611776 00000100:00100000:0.0:1787833684.541131:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787833684.541142:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342374780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375611776:12345-0@lo:13: 00002000:00000024:0.0:1787833684.541177:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833684.541232:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342374780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375611776:12345-0@lo:13: Request processed in 91us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833684.541240:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787833684.541394:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6459048000 x1874679375611776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833684.541418:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375611776:0@lo:13: 00010000:00010000:3.0:1787833685.308808:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833686.335198:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833687.356715:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833688.380912:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833688.637871:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375611904:0@lo:400: 00000100:00100000:3.0:1787833688.637959:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833688.638012:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375612416:0@lo:400: 00000100:00100000:1.0:1787833688.638026:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375611904 00000100:00100000:3.0:1787833688.638042:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833688.638046:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375611904 00000100:00100000:3.0:1787833688.638064:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833688.638070:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375612288:0@lo:400: 00000100:00100000:3.0:1787833688.638092:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833688.638095:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787833688.638103:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:3283:x1874679375611904:12345-0@lo:400: 00000100:00100000:1.0:1787833688.638154:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:3283:x1874679375611904:12345-0@lo:400: Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833688.638162:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787833688.638208:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375611904:0@lo:400: 00000100:00100000:0.0:1787833688.639654:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375612032:0@lo:400: 00000100:00100000:0.0:1787833688.639746:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833688.639823:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833688.639831:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375612160:0@lo:400: 00000100:00100000:0.0:1787833688.639855:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833688.639909:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375612416 00000100:00100000:0.0:1787833688.639915:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375612416 00000100:00100000:1.0:1787833688.639951:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375612032 00000100:00100000:1.0:1787833688.639955:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375612032 00000100:00100000:1.0:1787833688.648140:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375612160 00000100:00100000:1.0:1787833688.648157:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375612160 00000100:00100000:0.0:1787833688.657286:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787833688.657319:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459048780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375612032:12345-0@lo:400: 00000100:00100000:0.0:1787833688.657434:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459048780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375612032:12345-0@lo:400: Request processed in 122us (17688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833688.657441:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787833688.657460:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787833688.657468:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375612416:12345-0@lo:400: 00000100:00100000:0.0:1787833688.657511:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375612416:12345-0@lo:400: Request processed in 45us (19468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833688.657518:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787833688.657544:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375612288 00000100:00100000:0.0:1787833688.657553:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375612288 00010000:00080000:1.0:1787833688.657881:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa7ed00 x1874679375612416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833688.657897:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375612416:0@lo:400: 00000100:00100000:1.0:1787833688.657951:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833688.657958:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64590492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375612160:12345-0@lo:400: 00000100:00100000:1.0:1787833688.658006:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64590492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375612160:12345-0@lo:400: Request processed in 49us (18149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833688.658011:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787833688.658053:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa7f0c0 x1874679375612160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833688.658064:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375612160:0@lo:400: 00010000:00080000:1.0:1787833688.658074:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa7c780 x1874679375612032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833688.658083:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375612032:0@lo:400: 00000100:00080000:2.0:1787833688.658452:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833688.658459:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833688.672399:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833688.672416:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375612288:12345-0@lo:400: 00000100:00100000:0.0:1787833688.672543:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375612288:12345-0@lo:400: Request processed in 132us (34449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833688.672552:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787833688.672588:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa7e580 x1874679375612288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833688.672607:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375612288:0@lo:400: 00010000:00010000:0.0:1787833689.405697:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833689.662573:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375612544:0@lo:13: 00000100:00100000:1.0:1787833689.663081:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833689.663171:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375612544 00000100:00100000:1.0:1787833689.663179:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375612544 00000100:00100000:1.0:1787833689.663227:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787833689.663236:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342374b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375612544:12345-0@lo:13: 00002000:00000024:1.0:1787833689.663270:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833689.663319:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342374b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375612544:12345-0@lo:13: Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833689.663326:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787833689.663565:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6342375a40 x1874679375612544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833689.663586:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342375a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375612544:0@lo:13: 00010000:00010000:1.0:1787833690.437985:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787833691.280165:0:7966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787833691.452522:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787833692.220483:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787833692.220489:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b64773a1800 from 30 10000000:01000000:0.0:1787833692.220493:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787833692.220533:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833692.220543:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833692.220554:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833692.220590:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375612672:0@lo:101: 00000100:00100000:0.0:1787833692.220789:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833692.220840:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452d91780 going to sleep for 11 seconds 00000100:00100000:3.0:1787833692.224722:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375612672 00000100:00100000:3.0:1787833692.224741:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375612672 00000100:00100000:3.0:1787833692.224806:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787833692.224817:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375612672:12345-0@lo:101: 00010000:00010000:3.0:1787833692.224838:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833692.224858:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774c2e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.224918:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c2e expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.224929:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c2e expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.224938:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2ca00, rc 0) 00000100:00100000:3.0:1787833692.225024:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375612672:12345-0@lo:101: Request processed in 209us (4369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833692.225031:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787833692.225268:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375612672:0@lo:101: 00010000:00010000:3.0:1787833692.225288:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.225298:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833692.225393:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375612800:0@lo:501: 00000100:00100000:3.0:1787833692.225430:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.225541:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833692.225557:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375612800 00000100:00100000:3.0:1787833692.225561:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375612800 00000100:00100000:3.0:1787833692.225587:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787833692.225593:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375612800:12345-0@lo:501: 00000100:00100000:3.0:1787833692.227384:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375612800:12345-0@lo:501: Request processed in 1783us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833692.227397:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787833692.227471:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375612800:0@lo:501: 00000100:00100000:2.0:1787833692.227526:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375612928:0@lo:503: 00000100:00100000:2.0:1787833692.231172:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833692.231458:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787833692.231939:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375612928 00000100:00100000:3.0:1787833692.231950:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375612928 00000100:00100000:3.0:1787833692.232009:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787833692.232019:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375612928:12345-0@lo:503: 00000100:00100000:2.0:1787833692.232477:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375612928:0@lo:503: 00000100:00100000:3.0:1787833692.232602:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375612928:12345-0@lo:503: Request processed in 414us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833692.232611:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787833692.255111:0:8006:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8006:1874679375613056:0@lo:502: 00000100:00100000:3.0:1787833692.255197:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.255245:0:8006:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833692.255295:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375613056 00000100:00100000:0.0:1787833692.255302:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375613056 00000100:00100000:0.0:1787833692.255408:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787833692.255419:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:8006:x1874679375613056:12345-0@lo:502: 00000100:00100000:0.0:1787833692.255747:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:8006:x1874679375613056:12345-0@lo:502: Request processed in 330us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833692.255755:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787833692.255864:0:8006:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8006:1874679375613056:0@lo:502: 00000100:00100000:2.0:1787833692.255916:0:8006:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8006:1874679375613184:0@lo:502: 00000100:00100000:2.0:1787833692.255953:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833692.255985:0:8006:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787833692.256038:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375613184 00000100:00100000:0.0:1787833692.256042:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375613184 00000100:00100000:0.0:1787833692.256072:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787833692.256079:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:8006:x1874679375613184:12345-0@lo:502: 00000100:00100000:0.0:1787833692.256225:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:8006:x1874679375613184:12345-0@lo:502: Request processed in 146us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833692.256231:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787833692.256665:0:8006:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8006:1874679375613184:0@lo:502: 00000040:00080000:3.0:1787833692.256688:0:8006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787833692.257149:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787833692.257166:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787833692.257186:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.257197:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833692.257208:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787833692.257210:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787833692.257213:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787833692.257241:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.257248:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.257257:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833692.257270:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375613312:0@lo:101: 00000100:00100000:2.0:1787833692.257307:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833692.257366:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787833692.257422:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375613312 00000100:00100000:0.0:1787833692.257429:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375613312 00000100:00100000:0.0:1787833692.257481:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787833692.257490:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375613312:12345-0@lo:101: 00010000:00010000:0.0:1787833692.257500:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833692.257513:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774c3c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833692.257534:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c3c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833692.257551:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c3c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833692.257559:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031000, rc 0) 00000100:00100000:0.0:1787833692.257603:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375613312:12345-0@lo:101: Request processed in 114us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833692.257610:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787833692.257746:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375613312:0@lo:101: 00010000:00010000:3.0:1787833692.257759:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.257768:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833692.257820:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375613440:0@lo:501: 00000100:00100000:3.0:1787833692.257847:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.257872:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904000 going to sleep for 11 seconds 00000100:00100000:2.0:1787833692.257921:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375613440 00000100:00100000:2.0:1787833692.257925:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375613440 00000100:00100000:2.0:1787833692.257957:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787833692.257964:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375613440:12345-0@lo:501: 00000100:00100000:2.0:1787833692.258197:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375613440:12345-0@lo:501: Request processed in 233us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.258204:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787833692.258233:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375613440:0@lo:501: 00000100:00100000:2.0:1787833692.258258:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375613568:0@lo:503: 00000100:00100000:2.0:1787833692.258293:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833692.258307:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833692.258318:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375613568 00000100:00100000:2.0:1787833692.258321:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375613568 00000100:00100000:2.0:1787833692.258364:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787833692.258371:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375613568:12345-0@lo:503: 00000100:00100000:2.0:1787833692.258844:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375613568:12345-0@lo:503: Request processed in 473us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.258851:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787833692.258927:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375613568:0@lo:503: 00000100:00100000:3.0:1787833692.260329:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8009:1874679375613696:0@lo:502: 00000100:00100000:3.0:1787833692.260424:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.260463:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833692.260648:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375613696 00000100:00100000:0.0:1787833692.260655:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375613696 00000100:00100000:0.0:1787833692.260709:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787833692.260718:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:8009:x1874679375613696:12345-0@lo:502: 00000100:00100000:0.0:1787833692.260951:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:8009:x1874679375613696:12345-0@lo:502: Request processed in 235us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833692.260958:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787833692.261084:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8009:1874679375613696:0@lo:502: 00000020:01000000:3.0:1787833692.261127:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833692.261137:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833692.261139:0:8009:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787833692.261146:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787833692.261148:0:8009:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787833692.261165:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8009:1874679375613824:0@lo:502: 00000100:00100000:3.0:1787833692.261197:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.261219:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833692.261524:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375613824 00000100:00100000:0.0:1787833692.261529:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375613824 00000100:00100000:0.0:1787833692.261560:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787833692.261567:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:8009:x1874679375613824:12345-0@lo:502: 00000100:00100000:0.0:1787833692.262618:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:8009:x1874679375613824:12345-0@lo:502: Request processed in 1045us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833692.262628:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787833692.273310:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8009:1874679375613824:0@lo:502: 00000020:01000000:0.0:1787833692.273611:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833692.273625:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833692.273628:0:8009:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787833692.273634:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787833692.274247:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787833692.274276:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787833692.274287:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.274299:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833692.274322:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787833692.274325:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6460630000 from 30 10000000:01000000:2.0:1787833692.274327:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833692.274563:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.274573:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.274584:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833692.274606:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375613952:0@lo:101: 00000100:00100000:2.0:1787833692.274673:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833692.275214:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787833692.288821:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375613952 00000100:00100000:3.0:1787833692.288839:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375613952 00000100:00100000:3.0:1787833692.288911:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787833692.288921:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375613952:12345-0@lo:101: 00010000:00010000:3.0:1787833692.288939:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833692.288958:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774c4a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.288988:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c4a expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.289000:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c4a expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.289010:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2ce00, rc 0) 00000100:00100000:3.0:1787833692.289087:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375613952:12345-0@lo:101: Request processed in 168us (14413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833692.289094:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787833692.289169:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375613952:0@lo:101: 00010000:00010000:3.0:1787833692.290800:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.290820:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833692.290908:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614080:0@lo:501: 00000100:00100000:3.0:1787833692.290964:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.291002:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64779040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833692.291020:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375614080 00000100:00100000:3.0:1787833692.291027:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375614080 00000100:00100000:3.0:1787833692.291063:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787833692.291072:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375614080:12345-0@lo:501: 00000100:00100000:3.0:1787833692.291326:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375614080:12345-0@lo:501: Request processed in 254us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833692.291334:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787833692.294045:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614080:0@lo:501: 00000100:00100000:3.0:1787833692.294120:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614208:0@lo:503: 00000100:00100000:3.0:1787833692.294217:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.294263:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64779040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833692.294292:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375614208 00000100:00100000:3.0:1787833692.294299:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375614208 00000100:00100000:3.0:1787833692.295507:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787833692.295523:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375614208:12345-0@lo:503: 00000100:00100000:3.0:1787833692.295751:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375614208:12345-0@lo:503: Request processed in 234us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833692.295759:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787833692.295817:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614208:0@lo:503: 00000100:00100000:1.0:1787833692.298527:0:8014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342377c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8014:1874679375614336:0@lo:502: 00000100:00100000:1.0:1787833692.298605:0:8014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833692.298649:0:8014:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225000 going to sleep for 11 seconds 00000100:00100000:3.0:1787833692.299381:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375614336 00000100:00100000:3.0:1787833692.299390:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375614336 00000100:00100000:3.0:1787833692.299437:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787833692.299446:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:8014:x1874679375614336:12345-0@lo:502: 00000100:00100000:3.0:1787833692.299714:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:8014:x1874679375614336:12345-0@lo:502: Request processed in 268us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833692.299722:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787833692.299887:0:8014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342377c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8014:1874679375614336:0@lo:502: 00000100:00100000:2.0:1787833692.299948:0:8014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8014:1874679375614464:0@lo:502: 00000100:00100000:2.0:1787833692.299987:0:8014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833692.300011:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375614464 00000100:00100000:2.0:1787833692.300014:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375614464 00000100:00100000:2.0:1787833692.300043:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787833692.300050:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:8014:x1874679375614464:12345-0@lo:502: 00000100:00100000:2.0:1787833692.300177:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:8014:x1874679375614464:12345-0@lo:502: Request processed in 126us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.300183:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787833692.300217:0:8014:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833692.300228:0:8014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8014:1874679375614464:0@lo:502: 00000040:00080000:2.0:1787833692.300252:0:8014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787833692.300556:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787833692.300577:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787833692.300587:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.300598:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833692.300608:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787833692.300610:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6460630000 from 5 10000000:01000000:3.0:1787833692.300613:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787833692.300638:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.300645:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.300654:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833692.300666:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614592:0@lo:101: 00000100:00100000:3.0:1787833692.300692:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.300742:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904240 going to sleep for 11 seconds 00000100:00100000:1.0:1787833692.300780:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375614592 00000100:00100000:1.0:1787833692.300785:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375614592 00000100:00100000:1.0:1787833692.300813:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787833692.300819:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375614592:12345-0@lo:101: 00010000:00010000:1.0:1787833692.300828:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833692.300840:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774c58 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833692.300859:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c58 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833692.300874:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c58 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833692.300883:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198e00, rc 0) 00000100:00100000:1.0:1787833692.300916:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375614592:12345-0@lo:101: Request processed in 97us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833692.300922:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787833692.300992:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614592:0@lo:101: 00010000:00010000:3.0:1787833692.301003:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.301011:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833692.301047:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614720:0@lo:256: 00000100:00100000:3.0:1787833692.301072:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.301089:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904240 going to sleep for 11 seconds 00000100:00100000:1.0:1787833692.301150:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375614720 00000100:00100000:1.0:1787833692.301154:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375614720 00000100:00100000:1.0:1787833692.301181:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787833692.301187:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375614720:12345-0@lo:256: 20000000:01000000:1.0:1787833692.301200:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787833692.301216:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787833692.301219:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787833692.301286:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375614720:12345-0@lo:256: Request processed in 99us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833692.301294:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787833692.301524:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614720:0@lo:256: 10000000:01000000:3.0:1787833692.301559:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787833692.301564:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.301572:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833692.301578:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787833692.301580:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787833692.301582:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787833692.301595:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.301602:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.301610:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833692.301625:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614848:0@lo:101: 00000100:00100000:3.0:1787833692.301646:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.301670:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833692.301713:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375614848 00000100:00100000:2.0:1787833692.301717:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375614848 00000100:00100000:2.0:1787833692.301744:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787833692.301749:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375614848:12345-0@lo:101: 00010000:00010000:2.0:1787833692.301756:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833692.301764:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774c66 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.301778:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c66 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.301787:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c66 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.301794:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83200, rc 0) 00000100:00100000:2.0:1787833692.301825:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375614848:12345-0@lo:101: Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.301830:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787833692.301899:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614848:0@lo:101: 00010000:00010000:3.0:1787833692.301908:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833692.301916:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833692.301953:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614976:0@lo:501: 00000100:00100000:3.0:1787833692.301973:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.302017:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833692.304535:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375614976 00000100:00100000:2.0:1787833692.304550:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375614976 00000100:00100000:2.0:1787833692.304603:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787833692.304612:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375614976:12345-0@lo:501: 00000100:00100000:2.0:1787833692.304922:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375614976:12345-0@lo:501: Request processed in 310us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.304930:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787833692.305149:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375614976:0@lo:501: 00000100:00100000:1.0:1787833692.305200:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375615104:0@lo:503: 00000100:00100000:1.0:1787833692.305248:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833692.305274:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64462250c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833692.305370:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375615104 00000100:00100000:3.0:1787833692.305375:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375615104 00000100:00100000:3.0:1787833692.305406:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787833692.305414:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375615104:12345-0@lo:503: 00000100:00100000:3.0:1787833692.305725:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375615104:12345-0@lo:503: Request processed in 311us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833692.305733:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787833692.305835:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375615104:0@lo:503: 00000100:00100000:3.0:1787833692.307261:0:8015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8015:1874679375615232:0@lo:502: 00000100:00100000:3.0:1787833692.307315:0:8015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.307365:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375615232 00000100:00100000:3.0:1787833692.307370:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375615232 00000100:00100000:3.0:1787833692.307404:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787833692.307411:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8015:x1874679375615232:12345-0@lo:502: 00000100:00100000:3.0:1787833692.307662:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8015:x1874679375615232:12345-0@lo:502: Request processed in 251us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833692.307670:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787833692.307730:0:8015:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904480 going to sleep for 11 seconds 00000100:00100000:3.0:1787833692.307746:0:8015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8015:1874679375615232:0@lo:502: 00000020:01000000:3.0:1787833692.307768:0:8015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787833692.307776:0:8015:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787833692.307782:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833692.307785:0:8015:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787833692.307791:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787833692.307795:0:8015:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:3.0:1787833692.307816:0:8015:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787833692.307818:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833692.307831:0:8015:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b6452f2b490) 00000020:00000080:3.0:1787833692.307855:0:8015:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787833692.307859:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787833692.307923:0:8015:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787833692.307928:0:8015:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787833692.307935:0:8015:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e774c7b 00010000:00080000:3.0:1787833692.307973:0:8015:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b647f899800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:3.0:1787833692.308452:0:8015:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787833692.308727:0:8015:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787833692.308737:0:8015:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787833692.315969:0:8015:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787833692.316395:0:8015:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787833692.316455:0:8015:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787833692.316522:0:8015:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787833692.324691:0:8016:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833692.324714:0:8016:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787833692.325509:0:8015:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787833692.325520:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787833692.325557:0:8015:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787833692.325579:0:8015:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e774c82 00000100:00080000:2.0:1787833692.325587:0:8015:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787833692.325593:0:8015:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b647f899800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787833692.325625:0:8015:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6462315e00 x1874679375615360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833692.325702:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375615360:0@lo:8: 00000100:00100000:3.0:1787833692.325777:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787833692.325930:0:8015:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787833692.326029:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375615616:0@lo:400: 00000100:00100000:2.0:1787833692.326060:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833692.326084:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833692.326089:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6449185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375615744:0@lo:400: 00000100:00100000:2.0:1787833692.326244:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787833692.326310:0:8015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833692.326315:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833692.326317:0:8015:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787833692.326320:0:8015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833692.326324:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833692.326326:0:8015:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787833692.326328:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787833692.326330:0:8015:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787833692.326374:0:8015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8015:1874679375616000:0@lo:502: 00000100:00100000:2.0:1787833692.326414:0:8015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833692.326440:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375616000 00000100:00100000:2.0:1787833692.326446:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375616000 00000100:00100000:2.0:1787833692.326485:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787833692.326493:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8015:x1874679375616000:12345-0@lo:502: 00000100:00100000:2.0:1787833692.326717:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8015:x1874679375616000:12345-0@lo:502: Request processed in 223us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.326725:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787833692.326766:0:8015:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833692.326784:0:8015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8015:1874679375616000:0@lo:502: 00000020:01000000:2.0:1787833692.326807:0:8015:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833692.326811:0:8015:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833692.326813:0:8015:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787833692.326816:0:8015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1787833692.327048:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375615360 00000100:00100000:1.0:1787833692.327053:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375615360 00000100:00100000:1.0:1787833692.327074:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375615744 00000100:00100000:1.0:1787833692.327077:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375615744 00000100:00100000:1.0:1787833692.327132:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787833692.327139:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375615744:12345-0@lo:400: 00000100:00100000:1.0:1787833692.327185:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375615744:12345-0@lo:400: Request processed in 47us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833692.327191:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787833692.327205:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833692.327209:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3279:x1874679375615360:12345-0@lo:8: 00010000:00080000:1.0:1787833692.327230:0:6661:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1787833692.327255:0:6661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e774c89 00002000:00100000:1.0:1787833692.327269:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b6341829800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787833692.327274:0:6661:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787833692.327278:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787833692.327400:0:6661:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787833692.327557:0:6661:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787833692.327583:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9b634182c800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787833692.327816:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833692.327906:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1874679375615360:12345-0@lo:8: Request processed in 694us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833692.327913:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833692.327939:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375615488:0@lo:400: 00000100:00100000:1.0:1787833692.327971:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833692.328004:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833692.328011:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375615872:0@lo:400: 00000100:00100000:1.0:1787833692.328033:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833692.328075:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375615616 00000100:00100000:1.0:1787833692.328080:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375615616 00000100:00100000:2.0:1787833692.328200:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375615488 00000100:00100000:2.0:1787833692.328204:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375615488 00000100:00100000:2.0:1787833692.328233:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375615872 00000100:00100000:2.0:1787833692.328236:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375615872 00000100:00100000:2.0:1787833692.328250:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787833692.328256:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375615488:12345-0@lo:400: 00000100:00100000:2.0:1787833692.328298:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375615488:12345-0@lo:400: Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.328304:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787833692.328315:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787833692.328321:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375615872:12345-0@lo:400: 00000100:00100000:2.0:1787833692.328371:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375615872:12345-0@lo:400: Request processed in 50us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.328377:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787833692.328390:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787833692.328416:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6476ebe1c0 x1874679375615872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833692.328429:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375615872:0@lo:400: 00010000:00080000:2.0:1787833692.328440:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64623170c0 x1874679375615488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833692.328447:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375615488:0@lo:400: 00000100:00100000:1.0:1787833692.328625:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787833692.328634:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375615616:12345-0@lo:400: 00000100:00100000:1.0:1787833692.328674:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375615616:12345-0@lo:400: Request processed in 41us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833692.328680:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:01000000:1.0:1787833692.328709:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787833692.328733:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787833692.328743:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833692.328753:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833692.328762:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787833692.328765:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6443fdced8 from 1 10000000:01000000:1.0:1787833692.328768:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787833692.328795:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833692.328803:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833692.328813:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833692.328829:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b63423743c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375616128:0@lo:101: 00000100:00100000:1.0:1787833692.328857:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833692.328880:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225480 going to sleep for 11 seconds 00010000:00080000:1.0:1787833692.328911:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6449185e00 x1874679375615744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833692.328921:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6449185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375615744:0@lo:400: 00010000:00080000:1.0:1787833692.328942:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6462315a40 x1874679375615616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833692.328950:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375615616:0@lo:400: 00000100:00100000:2.0:1787833692.329016:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375616128 00000100:00100000:2.0:1787833692.329020:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375616128 00000100:00100000:2.0:1787833692.329058:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787833692.329065:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375616128:12345-0@lo:101: 00010000:00010000:2.0:1787833692.329073:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833692.329085:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774c90 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.329120:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c90 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.329131:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c90 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833692.329140:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c82a00, rc 0) 00000100:00100000:2.0:1787833692.329177:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375616128:12345-0@lo:101: Request processed in 113us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.329184:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787833692.329408:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b63423743c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375616128:0@lo:101: 00010000:00010000:1.0:1787833692.329423:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833692.329431:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833692.329473:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b63423743c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375616256:0@lo:501: 00000100:00100000:1.0:1787833692.329498:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833692.329520:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225480 going to sleep for 11 seconds 00000100:00100000:0.0:1787833692.329588:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375616256 00000100:00100000:0.0:1787833692.329593:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375616256 00000100:00100000:0.0:1787833692.329623:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787833692.329629:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375616256:12345-0@lo:501: 00000100:00100000:0.0:1787833692.329862:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375616256:12345-0@lo:501: Request processed in 232us (363us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833692.329870:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787833692.329940:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b63423743c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375616256:0@lo:501: 10000000:01000000:1.0:1787833692.329963:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787833692.329968:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833692.329975:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787833692.330213:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6462315e00 x1874679375615360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787833702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833692.330226:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787833692.330234:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787833692.330242:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787833692.330247:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787833692.330251:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b647f899800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787833692.330540:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787833692.330548:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375615360:0@lo:8: 00000004:00080000:2.0:1787833692.340756:0:8016:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787833692.341042:0:8016:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 171096701298ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787833692.430948:0:8020:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787833692.430976:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1874679375616512:0@lo:7: 00000100:00100000:0.0:1787833692.431042:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833692.431085:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833692.431112:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375616512 00000100:00100000:0.0:1787833692.431117:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375616512 00000100:00100000:0.0:1787833692.431164:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787833692.431172:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8020:x1874679375616512:12345-0@lo:7: 00000100:00100000:2.0:1787833692.436901:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375616384:0@lo:13: 00000100:00100000:2.0:1787833692.436990:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833692.437168:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375616384 00000100:00100000:1.0:1787833692.437177:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375616384 00000100:00100000:1.0:1787833692.437240:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787833692.437251:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375616384:12345-0@lo:13: 00002000:00000024:1.0:1787833692.437289:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787833692.437377:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375616384:12345-0@lo:13: Request processed in 128us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833692.437385:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787833692.437427:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b645904a1c0 x1874679375616384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833692.437448:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375616384:0@lo:13: 00000100:00080000:0.0:1787833692.445015:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1787833692.449901:0:6660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787833692.449909:0:6660:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787833692.450003:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8020:x1874679375616512:12345-0@lo:7: Request processed in 18826us (18955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833692.450014:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787833692.452832:0:8020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b645904a940 x1874679375616512/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787833708 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833692.452851:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1874679375616512:0@lo:7: 00000004:00080000:3.0:1787833692.452865:0:8020:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787833692.452905:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1874679375616640:0@lo:5: 00000100:00100000:3.0:1787833692.452961:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833692.453004:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477904540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833692.454812:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375616640 00000100:00100000:1.0:1787833692.454824:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375616640 00000100:00100000:1.0:1787833692.454875:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787833692.454885:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8020:x1874679375616640:12345-0@lo:5: 00002000:00080000:1.0:1787833692.454915:0:6661:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787833692.454920:0:6661:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787833692.455288:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8020:x1874679375616640:12345-0@lo:5: Request processed in 404us (2324us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787833692.455296:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787833692.458783:0:8020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa7f0c0 x1874679375616640/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833708 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833692.458807:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1874679375616640:0@lo:5: 00000004:00080000:1.0:1787833692.458827:0:8020:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787833692.458875:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b63423743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1874679375616768:0@lo:700: 00000100:00100000:1.0:1787833692.458947:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833692.459009:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601b1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833692.459039:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375616768 00000100:00100000:1.0:1787833692.459046:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375616768 00000100:00100000:1.0:1787833692.459093:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787833692.459102:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b63423770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8020:x1874679375616768:12345-0@lo:700: 00000100:00100000:1.0:1787833692.459137:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342377c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6667:1874679375616896:0@lo:700: 00000100:00100000:1.0:1787833692.459165:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833692.459183:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601b1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833692.459199:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375616896 00000100:00100000:1.0:1787833692.459203:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375616896 00000100:00100000:1.0:1787833692.459235:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787833692.459242:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6667:x1874679375616896:12345-0@lo:700: 00010000:00010000:1.0:1787833692.488090:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787833692.506098:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1787833692.547990:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787833692.553184:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6667:x1874679375616896:12345-0@lo:700: Request processed in 93935us (94010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833692.553195:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787833692.554620:0:6667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6342377c00 x1874679375616896/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787833708 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833692.554638:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342377c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6667:1874679375616896:0@lo:700: 40000000:02000000:3.0:1787833692.554653:0:6667:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1787833692.716579:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787833692.716606:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787833692.716853:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b63423770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8020:x1874679375616768:12345-0@lo:700: Request processed in 257746us (257899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833692.716866:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787833692.717024:0:8020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b63423743c0 x1874679375616768/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787833708 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833692.717046:0:8020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787833692.717064:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b63423743c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1874679375616768:0@lo:700: 00000004:02000040:3.0:1787833692.771541:0:8020:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787833692.784000:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1874679375617024:0@lo:5: 00000100:00100000:0.0:1787833692.784073:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833692.784132:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b646dd8c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833692.784158:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375617024 00000100:00100000:0.0:1787833692.784164:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375617024 00000100:00100000:0.0:1787833692.784217:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787833692.784227:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8020:x1874679375617024:12345-0@lo:5: 00002000:00080000:0.0:1787833692.792894:0:6660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787833692.792918:0:6660:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787833692.802838:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8020:x1874679375617024:12345-0@lo:5: Request processed in 18600us (18752us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787833692.802866:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787833692.802963:0:8020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b645904b0c0 x1874679375617024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787833708 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833692.802982:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1874679375617024:0@lo:5: 00000004:00080000:3.0:1787833692.802997:0:8020:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787833693.500567:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833694.530751:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833694.781564:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833694.781592:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375617152:0@lo:13: 00000100:00100000:0.0:1787833694.781666:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833694.781849:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375617152 00000100:00100000:1.0:1787833694.781858:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375617152 00000100:00100000:1.0:1787833694.781928:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787833694.781939:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375617152:12345-0@lo:13: 00002000:00000024:1.0:1787833694.781982:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833694.782032:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375617152:12345-0@lo:13: Request processed in 96us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833694.782039:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787833694.782189:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787833694.782223:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6342374f00 x1874679375617152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833694.782240:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375617152:0@lo:13: 00010000:00010000:1.0:1787833695.549819:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833696.572641:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787833696.910426:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1787833697.343591:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342377840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375617408:0@lo:400: 00000100:00100000:1.0:1787833697.343683:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833697.343743:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375617920:0@lo:400: 00000100:00100000:1.0:1787833697.343787:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833697.343818:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833697.343824:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b63423752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375617536:0@lo:400: 00000100:00100000:1.0:1787833697.343847:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833697.343857:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375617664:0@lo:400: 00000100:00100000:1.0:1787833697.343879:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375617408 00000100:00100000:1.0:1787833697.343885:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375617408 00000100:00100000:3.0:1787833697.343896:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833697.343918:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787833697.343923:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b63423761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375617280:0@lo:400: 00000100:00100000:1.0:1787833697.343927:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375617536 00000100:00100000:1.0:1787833697.343929:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375617536 00000100:00100000:3.0:1787833697.343950:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833697.343957:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787833697.343965:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b63423743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375617408:12345-0@lo:400: 00000100:00100000:3.0:1787833697.343968:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375617792:0@lo:400: 00000100:00100000:3.0:1787833697.343986:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833697.344004:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375617920 00000100:00100000:3.0:1787833697.344007:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375617920 00000100:00100000:1.0:1787833697.344012:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b63423743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375617408:12345-0@lo:400: Request processed in 48us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833697.344019:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787833697.344031:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375617664 00000100:00100000:1.0:1787833697.344032:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375617792 00000100:00100000:3.0:1787833697.344033:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375617664 00000100:00100000:1.0:1787833697.344034:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375617792 00000100:00100000:3.0:1787833697.344046:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833697.344046:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787833697.344051:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375617536:12345-0@lo:400: 00000100:00100000:3.0:1787833697.344052:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375617920:12345-0@lo:400: 00000100:00100000:3.0:1787833697.344079:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375617920:12345-0@lo:400: Request processed in 27us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833697.344079:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375617536:12345-0@lo:400: Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833697.344085:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833697.344086:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787833697.344096:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787833697.344102:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375617792:12345-0@lo:400: 00000100:00100000:1.0:1787833697.344134:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375617792:12345-0@lo:400: Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833697.344139:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787833697.344217:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833697.344231:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375617664:12345-0@lo:400: 00000100:00100000:3.0:1787833697.344261:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375617664:12345-0@lo:400: Request processed in 32us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833697.344266:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787833697.344594:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833697.344600:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833697.344603:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833697.344613:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375617280 00000100:00100000:0.0:1787833697.344617:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375617280 00000100:00100000:0.0:1787833697.344670:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787833697.344677:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375617280:12345-0@lo:400: 00000100:00100000:0.0:1787833697.344715:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375617280:12345-0@lo:400: Request processed in 39us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833697.344721:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787833697.346136:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b63423761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375617280:0@lo:400: 00010000:00080000:1.0:1787833697.346156:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6342374f00 x1874679375617792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833697.346187:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375617792:0@lo:400: 00010000:00080000:1.0:1787833697.346204:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6342376d00 x1874679375617664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833697.346214:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375617664:0@lo:400: 00010000:00080000:1.0:1787833697.346260:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b63423752c0 x1874679375617536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833697.346269:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b63423752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375617536:0@lo:400: 00010000:00080000:1.0:1787833697.346281:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6342377840 x1874679375617408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833697.346288:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342377840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375617408:0@lo:400: 00010000:00080000:1.0:1787833697.346299:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6342377480 x1874679375617920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833697.346306:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787833697.346318:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375617920:0@lo:400: 00000100:00100000:0.0:1787833697.573296:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833697.573399:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367204992 00000100:00100000:2.0:1787833697.573423:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367204992 00000100:00100000:2.0:1787833697.573475:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:2.0:1787833697.573483:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2343:x1874679367204992:12345-192.168.202.15@tcp:250: 00010000:00080000:2.0:1787833697.573512:0:5810:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from c7dee5a5-62c8-47df-824e-7aea04306fca@192.168.202.15@tcp t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:2.0:1787833697.573541:0:5810:0:(genops.c:1385:class_connect()) connect: client c7dee5a5-62c8-47df-824e-7aea04306fca, cookie 0x2bdb54ee5e774c9e 00000100:00080000:2.0:1787833697.573712:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9b6450237000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833697.573789:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+5:2343:x1874679367204992:12345-192.168.202.15@tcp:250: Request processed in 305us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833697.573797:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:2.0:1787833697.584767:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833697.584809:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367205120 00000100:00100000:2.0:1787833697.584818:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367205120 00000100:00100000:2.0:1787833697.584868:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:2.0:1787833697.584879:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+5:5575:x1874679367205120:12345-192.168.202.15@tcp:101: 00010000:00010000:2.0:1787833697.584897:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833697.584915:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3954 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833697.584942:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3954 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833697.584953:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3954 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833697.584961:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83e00, rc 0) 00000100:00100000:2.0:1787833697.585013:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+6:5575:x1874679367205120:12345-192.168.202.15@tcp:101: Request processed in 136us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833697.585021:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:2.0:1787833697.594635:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833697.594739:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367205248 00000100:00100000:0.0:1787833697.594750:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367205248 00000100:00100000:0.0:1787833697.594806:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:0.0:1787833697.594816:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+6:5575:x1874679367205248:12345-192.168.202.15@tcp:501: 00000100:00100000:0.0:1787833697.595245:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+6:5575:x1874679367205248:12345-192.168.202.15@tcp:501: Request processed in 430us (617us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833697.595253:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 114 00010000:00010000:3.0:1787833697.596504:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833697.599039:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833697.599249:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367205376 00000100:00100000:0.0:1787833697.599258:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367205376 00000100:00100000:0.0:1787833697.599316:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:0.0:1787833697.599326:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+6:5575:x1874679367205376:12345-192.168.202.15@tcp:101: 00010000:00010000:0.0:1787833697.599373:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833697.599394:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe395b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833697.599426:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe395b expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833697.599439:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe395b expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833697.599448:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440030600, rc 0) 00000100:00100000:0.0:1787833697.599511:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+7:5575:x1874679367205376:12345-192.168.202.15@tcp:101: Request processed in 186us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833697.599518:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:3.0:1787833697.601916:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833697.602262:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367205504 00000100:00100000:0.0:1787833697.602273:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367205504 00000100:00100000:0.0:1787833697.602329:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:0.0:1787833697.602363:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+7:5575:x1874679367205504:12345-192.168.202.15@tcp:501: 00000100:00100000:0.0:1787833697.602668:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+8:5575:x1874679367205504:12345-192.168.202.15@tcp:501: Request processed in 328us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833697.602677:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:3.0:1787833697.604466:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833697.604620:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367205632 00000100:00100000:0.0:1787833697.604629:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367205632 00000100:00100000:0.0:1787833697.604695:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:0.0:1787833697.604718:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+8:5575:x1874679367205632:12345-192.168.202.15@tcp:503: 00000100:00100000:0.0:1787833697.605073:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+8:5575:x1874679367205632:12345-192.168.202.15@tcp:503: Request processed in 355us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833697.605081:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:3.0:1787833697.609258:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833697.609391:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367205760 00000100:00100000:1.0:1787833697.609400:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367205760 00000100:00100000:1.0:1787833697.609451:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:1.0:1787833697.609460:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+8:5593:x1874679367205760:12345-192.168.202.15@tcp:502: 00000100:00100000:1.0:1787833697.609791:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+8:5593:x1874679367205760:12345-192.168.202.15@tcp:502: Request processed in 330us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833697.609799:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:0.0:1787833697.641783:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833697.641874:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367205888 00000100:00100000:2.0:1787833697.641884:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367205888 00000100:00100000:2.0:1787833697.641941:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:2.0:1787833697.641952:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+8:5593:x1874679367205888:12345-192.168.202.15@tcp:502: 00000100:00100000:2.0:1787833697.642820:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+8:5593:x1874679367205888:12345-192.168.202.15@tcp:502: Request processed in 865us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833697.642830:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:2.0:1787833697.662535:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833697.666700:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367206016 00000100:00100000:2.0:1787833697.666715:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367206016 00000100:00100000:2.0:1787833697.666771:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:2.0:1787833697.666781:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+8:5575:x1874679367206016:12345-192.168.202.15@tcp:101: 00010000:00010000:2.0:1787833697.666798:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833697.666815:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c82c00/0x2bdb54ee5e774cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3985 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833697.666842:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c82c00/0x2bdb54ee5e774cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3985 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833697.666854:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c82c00/0x2bdb54ee5e774cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3985 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833697.666863:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c82c00, rc 0) 00000100:00100000:2.0:1787833697.666930:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5575:x1874679367206016:12345-192.168.202.15@tcp:101: Request processed in 150us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833697.666937:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:0.0:1787833697.669781:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833697.672213:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367206144 00000100:00100000:2.0:1787833697.672242:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367206144 00000100:00100000:2.0:1787833697.672466:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:2.0:1787833697.672477:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5575:x1874679367206144:12345-192.168.202.15@tcp:256: 20000000:01000000:2.0:1787833697.672501:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787833697.672519:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787833697.672523:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787833697.672526:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787833697.672529:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787833697.674498:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5575:x1874679367206144:12345-192.168.202.15@tcp:256: Request processed in 2014us (4718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833697.674512:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:0.0:1787833697.679263:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833697.679736:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367206272 00000100:00100000:1.0:1787833697.679759:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367206272 00000100:00100000:1.0:1787833697.679813:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:1.0:1787833697.679823:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5575:x1874679367206272:12345-192.168.202.15@tcp:101: 00010000:00010000:1.0:1787833697.679840:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833697.679857:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe398c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833697.679885:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe398c expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833697.679896:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe398c expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833697.679905:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198c00, rc 0) 00000100:00100000:1.0:1787833697.679965:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5575:x1874679367206272:12345-192.168.202.15@tcp:101: Request processed in 143us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833697.679973:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:3.0:1787833697.682019:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833697.682185:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367206400 00000100:00100000:0.0:1787833697.682193:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367206400 00000100:00100000:0.0:1787833697.682247:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:0.0:1787833697.682256:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5575:x1874679367206400:12345-192.168.202.15@tcp:501: 00000100:00100000:0.0:1787833697.682577:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5575:x1874679367206400:12345-192.168.202.15@tcp:501: Request processed in 321us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833697.682585:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:0.0:1787833697.684678:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833697.685028:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367206528 00000100:00100000:3.0:1787833697.685040:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367206528 00000100:00100000:3.0:1787833697.685258:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:3.0:1787833697.685282:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5575:x1874679367206528:12345-192.168.202.15@tcp:503: 00000100:00100000:2.0:1787833697.686808:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5575:x1874679367206528:12345-192.168.202.15@tcp:503: Request processed in 1532us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833697.686820:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:2.0:1787833697.690389:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833697.690455:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367206656 00000100:00100000:3.0:1787833697.690465:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367206656 00000100:00100000:3.0:1787833697.690520:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:3.0:1787833697.690529:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5596:x1874679367206656:12345-192.168.202.15@tcp:502: 00000100:00100000:3.0:1787833697.691598:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5596:x1874679367206656:12345-192.168.202.15@tcp:502: Request processed in 1063us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833697.691620:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:2.0:1787833697.693534:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833697.693603:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367206784 00000100:00100000:0.0:1787833697.693621:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367206784 00000100:00100000:0.0:1787833697.693680:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:0.0:1787833697.693691:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5596:x1874679367206784:12345-192.168.202.15@tcp:502: 00000100:00100000:0.0:1787833697.693918:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5596:x1874679367206784:12345-192.168.202.15@tcp:502: Request processed in 229us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833697.693927:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:0.0:1787833697.702728:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833697.702846:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367206912 00000100:00100000:2.0:1787833697.702856:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367206912 00000100:00100000:2.0:1787833697.702936:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:2.0:1787833697.702944:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459049680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2343:x1874679367206912:12345-192.168.202.15@tcp:38: 00010000:00080000:2.0:1787833697.702974:0:5817:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:2.0:1787833697.703024:0:5817:0:(genops.c:1385:class_connect()) connect: client 320cb14b-678a-483a-8914-ee446104f369, cookie 0x2bdb54ee5e774cc1 00000004:00100000:2.0:1787833697.703063:0:5817:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1787833697.703070:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787833697.734850:0:5817:0:(import.c:65:import_set_state_nolock()) ffff9b634304b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787833697.734976:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459049680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:2343:x1874679367206912:12345-192.168.202.15@tcp:38: Request processed in 32030us (32256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833697.734987:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:1.0:1787833697.854442:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375618048:0@lo:13: 00000100:00100000:1.0:1787833697.854540:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833697.855378:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375618048 00000100:00100000:0.0:1787833697.855388:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375618048 00000100:00100000:0.0:1787833697.855462:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787833697.855472:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375618048:12345-0@lo:13: 00002000:00000024:0.0:1787833697.855510:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833697.855568:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375618048:12345-0@lo:13: Request processed in 98us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833697.855576:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787833697.855850:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa7e580 x1874679375618048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833697.855871:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375618048:0@lo:13: 00000100:00100000:2.0:1787833698.488797:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833698.488902:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367207040 00000100:00100000:0.0:1787833698.488922:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367207040 00000100:00100000:0.0:1787833698.489013:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787833698.489025:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:0:x1874679367207040:12345-192.168.202.15@tcp:41: 00000004:00000024:0.0:1787833698.489076:0:5815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787833698.489153:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:0:x1874679367207040:12345-192.168.202.15@tcp:41: Request processed in 130us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833698.489161:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00080000:2.0:1787833698.489403:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833698.489606:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833698.489918:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367207168 00000100:00100000:0.0:1787833698.489924:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367207168 00000100:00100000:0.0:1787833698.489965:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:0.0:1787833698.489973:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:5575:x1874679367207168:12345-192.168.202.15@tcp:41: 00000004:00000024:0.0:1787833698.489989:0:7195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787833698.490047:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:5575:x1874679367207168:12345-192.168.202.15@tcp:41: Request processed in 74us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833698.490071:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787833698.494246:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833698.495496:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367207296 00000100:00100000:0.0:1787833698.495508:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367207296 00000100:00100000:0.0:1787833698.495574:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787833698.495584:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:5575:x1874679367207296:12345-192.168.202.15@tcp:40: 00000100:00100000:0.0:1787833698.495711:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:5575:x1874679367207296:12345-192.168.202.15@tcp:40: Request processed in 129us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833698.495719:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787833698.498774:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833698.498817:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833698.498856:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833698.498903:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833698.498948:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367207424 00000100:00100000:1.0:1787833698.498967:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367207424 00000100:00100000:1.0:1787833698.499013:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367207552 00000100:00100000:1.0:1787833698.499017:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367207552 00000100:00100000:1.0:1787833698.499031:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787833698.499039:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b63423752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1874679367207424:12345-192.168.202.15@tcp:8: 00010000:00080000:1.0:1787833698.499071:0:6659:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:1.0:1787833698.499103:0:6659:0:(genops.c:1385:class_connect()) connect: client 320cb14b-678a-483a-8914-ee446104f369, cookie 0x2bdb54ee5e774cc8 00002000:00100000:1.0:1787833698.499115:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 320cb14b-678a-483a-8914-ee446104f369/ffff9b634182e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787833698.499140:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787833698.499516:0:6659:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787833698.499557:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b634182d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833698.499619:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b63423752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:2343:x1874679367207424:12345-192.168.202.15@tcp:8: Request processed in 580us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833698.499626:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787833698.499655:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787833698.499660:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342376d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1874679367207552:12345-192.168.202.15@tcp:8: 00010000:00080000:1.0:1787833698.499676:0:6659:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:1.0:1787833698.499691:0:6659:0:(genops.c:1385:class_connect()) connect: client 320cb14b-678a-483a-8914-ee446104f369, cookie 0x2bdb54ee5e774ccf 00002000:00100000:1.0:1787833698.499696:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 320cb14b-678a-483a-8914-ee446104f369/ffff9b634182c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787833698.499703:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787833698.499904:0:6659:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787833698.499919:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b634182b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833698.499944:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342376d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:2343:x1874679367207552:12345-192.168.202.15@tcp:8: Request processed in 282us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833698.499951:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787833698.500537:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367207680 00000100:00100000:3.0:1787833698.500545:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367207680 00000100:00100000:3.0:1787833698.500592:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:3.0:1787833698.500610:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+6:5575:x1874679367207680:12345-192.168.202.15@tcp:33: 00000100:00100000:0.0:1787833698.502254:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367207808 00000100:00100000:0.0:1787833698.502264:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367207808 00000100:00100000:0.0:1787833698.502319:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 127 00000100:00100000:0.0:1787833698.502328:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2347:x1874679367207808:12345-192.168.202.15@tcp:400: 00000100:00100000:0.0:1787833698.502847:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2347:x1874679367207808:12345-192.168.202.15@tcp:400: Request processed in 518us (4027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833698.502855:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 127 00000004:00080000:3.0:1787833698.539235:0:5818:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 38548us 00000004:00200000:0.0:1787833698.564225:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787833698.564466:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+6:5575:x1874679367207680:12345-192.168.202.15@tcp:33: Request processed in 63852us (65695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833698.564483:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00010000:00010000:1.0:1787833698.620659:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833698.845542:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833698.845861:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367207936 00000100:00100000:2.0:1787833698.845876:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367207936 00000100:00100000:2.0:1787833698.845958:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787833698.845969:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:5613:x1874679367207936:12345-192.168.202.15@tcp:101: 00010000:00010000:2.0:1787833698.846032:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833698.847603:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774cd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe39b6 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833698.849454:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e774cdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833698.849473:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e774cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833698.849492:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e774cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833698.849721:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787833698.849725:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833698.850196:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e774cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833698.850235:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774cd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39b6 expref: 8 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833698.850253:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e774cdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39b6 expref: 7 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833698.850262:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279200) 00010000:00010000:2.0:1787833698.850265:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833698.850268:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83800, rc 0) 00000100:00100000:2.0:1787833698.851001:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+7:5613:x1874679367207936:12345-192.168.202.15@tcp:101: Request processed in 5029us (5471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833698.851012:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00010000:00010000:1.0:1787833699.644728:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833699.901563:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375618176:0@lo:13: 00000100:00100000:3.0:1787833699.901686:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833699.901868:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375618176 00000100:00100000:0.0:1787833699.901878:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375618176 00000100:00100000:0.0:1787833699.901960:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787833699.901971:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375618176:12345-0@lo:13: 00002000:00000024:0.0:1787833699.902000:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833699.902057:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375618176:12345-0@lo:13: Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833699.902083:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787833699.902311:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6342374f00 x1874679375618176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833699.902335:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375618176:0@lo:13: 00000100:00080000:2.0:1787833699.902643:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787833700.668662:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833701.329171:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833701.331469:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367208064 00000100:00100000:0.0:1787833701.331482:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367208064 00000100:00100000:0.0:1787833701.331582:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00080000:2.0:1787833701.331597:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833701.331597:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+7:5665:x1874679367208064:12345-192.168.202.15@tcp:41: 00000004:00000024:0.0:1787833701.331672:0:5815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787833701.331762:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+7:5665:x1874679367208064:12345-192.168.202.15@tcp:41: Request processed in 170us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833701.331770:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787833701.339717:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833701.339862:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367208192 00000100:00100000:1.0:1787833701.339875:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367208192 00000100:00100000:1.0:1787833701.339950:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787833701.339962:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:320cb14b-678a-483a-8914-ee446104f369+6:5665:x1874679367208192:12345-192.168.202.15@tcp:13: 00002000:00000024:1.0:1787833701.340013:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787833701.340018:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833701.340092:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:320cb14b-678a-483a-8914-ee446104f369+6:5665:x1874679367208192:12345-192.168.202.15@tcp:13: Request processed in 132us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833701.340100:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787833701.344060:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833701.344264:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367208320 00000100:00100000:2.0:1787833701.344281:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367208320 00000100:00080000:0.0:1787833701.344409:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833701.344445:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787833701.344459:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:320cb14b-678a-483a-8914-ee446104f369+6:5665:x1874679367208320:12345-192.168.202.15@tcp:13: 00002000:00000024:2.0:1787833701.344512:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833701.344608:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:320cb14b-678a-483a-8914-ee446104f369+6:5665:x1874679367208320:12345-192.168.202.15@tcp:13: Request processed in 152us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833701.344627:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00010000:00010000:1.0:1787833701.692555:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787833702.033723:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000100:00100000:3.0:1787833702.460698:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833702.460730:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375618432:0@lo:400: 00000100:00100000:3.0:1787833702.460799:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833702.460877:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375618432 00000100:00100000:3.0:1787833702.460885:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375618432 00000100:00100000:3.0:1787833702.460929:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787833702.460937:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a40b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375618432:12345-0@lo:400: 00000100:00100000:3.0:1787833702.460984:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a40b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375618432:12345-0@lo:400: Request processed in 48us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833702.460991:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787833702.461034:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375618432:0@lo:400: 00000100:00100000:3.0:1787833702.461076:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1874679375618560:0@lo:400: 00000100:00100000:3.0:1787833702.461099:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833702.461129:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375618560 00000100:00100000:3.0:1787833702.461133:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375618560 00000100:00100000:3.0:1787833702.461165:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787833702.461171:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a409e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874679375618560:12345-0@lo:400: 00000100:00100000:3.0:1787833702.461212:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a409e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874679375618560:12345-0@lo:400: Request processed in 41us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833702.461235:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787833702.461264:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833702.461287:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1874679375618560:0@lo:400: 00000100:00100000:3.0:1787833702.461322:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833702.461328:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375618944:0@lo:400: 00000100:00100000:3.0:1787833702.461399:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833702.461678:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375618688:0@lo:400: 00000100:00100000:1.0:1787833702.461714:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833702.461742:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787833702.461747:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a40bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375618304:0@lo:400: 00000100:00100000:1.0:1787833702.461773:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833702.461802:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a408780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375618816:0@lo:400: 00000100:00100000:1.0:1787833702.461823:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833702.461852:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375618944 00000100:00100000:1.0:1787833702.461857:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375618944 00000100:00100000:1.0:1787833702.461894:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375618688 00000100:00100000:1.0:1787833702.461897:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375618688 00000100:00100000:1.0:1787833702.461913:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787833702.461919:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375618944:12345-0@lo:400: 00000100:00100000:1.0:1787833702.461967:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375618944:12345-0@lo:400: Request processed in 48us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833702.461973:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787833702.461991:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787833702.461997:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342374f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375618688:12345-0@lo:400: 00000100:00100000:1.0:1787833702.462025:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342374f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375618688:12345-0@lo:400: Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833702.462030:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787833702.462043:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833702.462046:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787833702.462053:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375618816 00000100:00100000:1.0:1787833702.462056:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375618816 00000100:00100000:1.0:1787833702.462079:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833702.462085:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b63423761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375618816:12345-0@lo:400: 00000100:00100000:1.0:1787833702.462109:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b63423761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375618816:12345-0@lo:400: Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833702.462113:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787833702.462124:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833702.462145:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a408780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375618816:0@lo:400: 00010000:00080000:1.0:1787833702.462156:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b645a409a40 x1874679375618688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833702.462165:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375618688:0@lo:400: 00010000:00080000:1.0:1787833702.462186:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b645a40b480 x1874679375618944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833702.462194:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375618944:0@lo:400: 00000100:00100000:3.0:1787833702.462326:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375618304 00000100:00100000:3.0:1787833702.462331:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375618304 00000100:00100000:3.0:1787833702.462504:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787833702.462512:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375618304:12345-0@lo:400: 00000100:00100000:3.0:1787833702.462548:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375618304:12345-0@lo:400: Request processed in 38us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833702.462554:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787833702.462681:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a40bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375618304:0@lo:400: 00010000:00010000:1.0:1787833702.717577:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833702.972828:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833702.972923:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375619072:0@lo:13: 00000100:00100000:0.0:1787833702.973001:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833702.973063:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375619072 00000100:00100000:0.0:1787833702.973071:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375619072 00000100:00100000:0.0:1787833702.973119:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787833702.973128:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375619072:12345-0@lo:13: 00002000:00000024:0.0:1787833702.973152:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833702.973204:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375619072:12345-0@lo:13: Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833702.973213:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787833702.973254:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f9f9680 x1874679375619072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833702.973273:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375619072:0@lo:13: 00000001:00100000:2.0:1787833703.024997:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000001:00100000:0.0:1787833703.030770:0:5838:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000100:00100000:2.0:1787833703.600210:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833703.600262:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833703.600302:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833703.600334:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367208832 00000100:00100000:2.0:1787833703.600384:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833703.600390:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367208832 00000100:00100000:2.0:1787833703.600422:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367208704 00000100:00100000:2.0:1787833703.600427:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367208704 00000100:00100000:3.0:1787833703.600454:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367208576 00000100:00100000:3.0:1787833703.600468:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367208576 00000100:00100000:1.0:1787833703.600482:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787833703.600497:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367208832:12345-192.168.202.15@tcp:400: 00000100:00100000:0.0:1787833703.600519:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367208448 00000100:00100000:0.0:1787833703.600526:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367208448 00000100:00100000:0.0:1787833703.600574:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 129 00000100:00100000:0.0:1787833703.600582:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2346:x1874679367208448:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787833703.600591:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367208832:12345-192.168.202.15@tcp:400: Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833703.600612:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787833703.600629:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2346:x1874679367208448:12345-192.168.202.15@tcp:400: Request processed in 47us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833703.600635:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787833703.600647:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 129 00000100:00100000:3.0:1787833703.600657:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:1.0:1787833703.600657:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367208704:12345-192.168.202.15@tcp:400: 00000100:00100000:3.0:1787833703.600681:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367208576:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787833703.600701:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367208704:12345-192.168.202.15@tcp:400: Request processed in 54us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833703.600710:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:3.0:1787833703.600758:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367208576:12345-192.168.202.15@tcp:400: Request processed in 84us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833703.600766:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00080000:3.0:1787833703.600822:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833703.600828:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833703.600831:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787833703.748546:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787833704.598914:0:8279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787833704.766716:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833705.021079:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6449185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375619200:0@lo:13: 00000100:00100000:2.0:1787833705.021158:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833705.021534:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375619200 00000100:00100000:3.0:1787833705.021554:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375619200 00000100:00100000:3.0:1787833705.021632:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787833705.021653:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375619200:12345-0@lo:13: 00002000:00000024:3.0:1787833705.021693:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833705.021754:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375619200:12345-0@lo:13: Request processed in 102us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833705.021762:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787833705.022096:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6449185e00 x1874679375619200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833705.022119:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6449185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375619200:0@lo:13: 00000100:00080000:1.0:1787833705.022233:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787833705.791091:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833706.817917:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833707.580857:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375619712:0@lo:400: 00000100:00100000:3.0:1787833707.581011:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375619328:0@lo:400: 00000100:00100000:3.0:1787833707.582308:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833707.582393:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375619840:0@lo:400: 00000100:00100000:3.0:1787833707.582430:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833707.582506:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375619328 00000100:00100000:0.0:1787833707.582523:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375619328 00000100:00100000:0.0:1787833707.582622:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787833707.582635:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3283:x1874679375619328:12345-0@lo:400: 00000100:00100000:0.0:1787833707.582754:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3283:x1874679375619328:12345-0@lo:400: Request processed in 110us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833707.582764:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787833707.582846:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375619328:0@lo:400: 00000100:00100000:3.0:1787833707.582952:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375619456:0@lo:400: 00000100:00100000:3.0:1787833707.582990:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833707.583021:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375619968:0@lo:400: 00000100:00100000:3.0:1787833707.583047:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833707.583068:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833707.583074:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375619584:0@lo:400: 00000100:00100000:3.0:1787833707.583095:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833707.583138:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375619840 00000100:00100000:3.0:1787833707.583145:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375619840 00000100:00100000:3.0:1787833707.583195:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375619456 00000100:00100000:3.0:1787833707.583198:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375619456 00000100:00100000:3.0:1787833707.583210:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375619584 00000100:00100000:3.0:1787833707.583212:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375619584 00000100:00100000:3.0:1787833707.583235:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833707.583243:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a40bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375619840:12345-0@lo:400: 00000100:00100000:3.0:1787833707.583297:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a40bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375619840:12345-0@lo:400: Request processed in 54us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833707.583305:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833707.583354:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787833707.583361:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375619456:12345-0@lo:400: 00000100:00100000:3.0:1787833707.583393:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375619456:12345-0@lo:400: Request processed in 32us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833707.583399:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787833707.583409:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787833707.583415:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a408780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375619584:12345-0@lo:400: 00000100:00100000:3.0:1787833707.583437:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a408780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375619584:12345-0@lo:400: Request processed in 22us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833707.583444:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787833707.583495:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375619584:0@lo:400: 00000100:00100000:3.0:1787833707.583505:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375619456:0@lo:400: 00000100:00100000:3.0:1787833707.583619:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375619840:0@lo:400: 00000100:00080000:1.0:1787833707.584739:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833707.587195:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833707.587497:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375619968 00000100:00100000:2.0:1787833707.587507:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375619968 00000100:00100000:0.0:1787833707.587715:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375619712 00000100:00100000:0.0:1787833707.587720:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375619712 00000100:00100000:0.0:1787833707.587797:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787833707.587807:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375619712:12345-0@lo:400: 00000100:00100000:0.0:1787833707.587896:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375619712:12345-0@lo:400: Request processed in 91us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833707.587904:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787833707.588891:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833707.588898:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833707.589507:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6476ebd680 x1874679375619712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833707.589633:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787833707.589735:0:6661:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787833707.589755:0:6661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787833707.589979:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375619712:0@lo:400: 00000100:00100000:2.0:1787833707.590030:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a409a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375619968:12345-0@lo:400: 00010000:00080000:3.0:1787833707.591855:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6476ebe580 x1874679375619968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833707.591873:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375619968:0@lo:400: 00000100:00100000:2.0:1787833707.592174:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a409a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375619968:12345-0@lo:400: Request processed in 2529us (9123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833707.592186:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787833707.837673:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833708.093943:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833708.093984:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375620096:0@lo:13: 00000100:00100000:3.0:1787833708.094126:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833708.094218:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375620096 00000100:00100000:3.0:1787833708.094228:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375620096 00000100:00100000:3.0:1787833708.094303:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787833708.094315:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452889e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375620096:12345-0@lo:13: 00002000:00000024:3.0:1787833708.094391:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833708.095671:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452889e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375620096:12345-0@lo:13: Request processed in 1351us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833708.095685:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787833708.095800:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f9f92c0 x1874679375620096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833708.095827:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375620096:0@lo:13: 00000020:00000080:1.0:1787833708.715994:0:8429:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd5271fa0 20000000:00000080:1.0:1787833708.716020:0:8429:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b647fd88400 uarg=0000000000000000 20000000:01000000:1.0:1787833708.716142:0:8429:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787833708.716146:0:8429:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787833708.716148:0:8429:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787833708.716154:0:8429:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787833708.716161:0:8429:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787833708.716178:0:8429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787833708.716181:0:8429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787833708.716464:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787833708.716473:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787833708.717662:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787833708.718224:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787833708.718300:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787833708.721815:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787833708.721876:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787833708.721879:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000100:00100000:2.0:1787833708.722649:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833708.722697:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833708.722735:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833708.722772:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833708.722806:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367209088 00000100:00100000:2.0:1787833708.722819:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367209088 00000100:00100000:2.0:1787833708.722901:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:2.0:1787833708.722927:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367209088:12345-192.168.202.15@tcp:400: 00000100:00100000:2.0:1787833708.723034:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367209088:12345-192.168.202.15@tcp:400: Request processed in 123us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.723043:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00080000:2.0:1787833708.723069:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833708.723241:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367208960 00000100:00100000:1.0:1787833708.723246:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367208960 00000100:00100000:1.0:1787833708.723287:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:1.0:1787833708.723296:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2345:x1874679367208960:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787833708.723335:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2345:x1874679367208960:12345-192.168.202.15@tcp:400: Request processed in 41us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.723370:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:1.0:1787833708.724828:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367209216 00000100:00100000:1.0:1787833708.724841:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367209216 00000100:00100000:1.0:1787833708.724915:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367209344 00000100:00100000:1.0:1787833708.724919:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367209344 00000100:00100000:1.0:1787833708.724947:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787833708.724958:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367209216:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787833708.725028:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367209216:12345-192.168.202.15@tcp:400: Request processed in 71us (2330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.725036:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787833708.725055:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787833708.725063:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367209344:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787833708.725089:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367209344:12345-192.168.202.15@tcp:400: Request processed in 27us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.725095:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000040:00080000:3.0:1787833708.726249:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00080000:2.0:1787833708.726499:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833708.726507:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787833708.727206:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787833708.727273:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787833708.727316:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787833708.727331:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787833708.727389:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787833708.728973:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787833708.729508:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787833708.729570:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787833708.729616:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787833708.729630:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787833708.729633:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787833708.730680:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787833708.731091:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787833708.731161:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787833708.731202:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1787833708.731219:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787833708.731245:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731268:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774bda expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731278:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c04 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731287:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c2e expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731307:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c3c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731315:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c4a expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731322:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c66 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731330:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774c90 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731583:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3954 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731594:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe395b expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731603:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731654:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe395b expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731672:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe395b expref: 9 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833708.731690:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6452888780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620224:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833708.731867:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3954 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731884:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3954 expref: 9 pid: 5807 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833708.731894:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6452889a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620352:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833708.731928:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774c90 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.731936:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c90 expref: 18 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833708.731947:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6452888b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620480:0@lo:104: 00000100:00100000:3.0:1787833708.732003:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787833708.732043:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774c66 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.732052:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c66 expref: 18 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833708.732061:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620608:0@lo:104: 00010000:00010000:3.0:1787833708.732084:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774c4a expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.732093:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c4a expref: 18 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833708.732102:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620736:0@lo:104: 00010000:00010000:3.0:1787833708.732123:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774c3c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.732137:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c3c expref: 18 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833708.732146:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620864:0@lo:104: 00010000:00010000:3.0:1787833708.732170:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774c2e expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.732178:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c2e expref: 18 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833708.732186:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64528883c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620992:0@lo:104: 00010000:00010000:3.0:1787833708.732206:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774c04 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.732213:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c04 expref: 18 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833708.732220:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375621120:0@lo:104: 00010000:00010000:3.0:1787833708.732245:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774bda expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833708.732253:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774bda expref: 18 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833708.732261:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6452889680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375621248:0@lo:104: 00000100:00100000:3.0:1787833708.732277:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833708.732661:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787833708.732687:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833708.732717:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833708.732727:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833708.732735:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833708.732743:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833708.732768:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833708.732779:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375620480 00000100:00100000:1.0:1787833708.732787:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375620480 00000100:00100000:1.0:1787833708.732847:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375620608 00000100:00100000:1.0:1787833708.732851:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375620608 00000100:00100000:1.0:1787833708.732862:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375620736 00000100:00100000:1.0:1787833708.732864:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375620736 00000100:00100000:1.0:1787833708.732872:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375620864 00000100:00100000:1.0:1787833708.732874:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375620864 00000100:00100000:1.0:1787833708.732883:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375620992 00000100:00100000:1.0:1787833708.732885:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375620992 00000100:00100000:1.0:1787833708.732893:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375621120 00000100:00100000:1.0:1787833708.732895:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375621120 00000100:00100000:1.0:1787833708.732903:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375621248 00000100:00100000:1.0:1787833708.732905:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375621248 00000100:00100000:1.0:1787833708.732919:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787833708.732929:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341106050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:8429:x1874679375620480:12345-0@lo:104: 00010000:00010000:1.0:1787833708.732945:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733019:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833708.733027:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341106050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+9:8429:x1874679375620480:12345-0@lo:104: Request processed in 99us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.733035:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787833708.733083:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833708.733090:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+8:8429:x1874679375620608:12345-0@lo:104: 00010000:00010000:1.0:1787833708.733098:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733131:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787833708.733137:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+8:8429:x1874679375620608:12345-0@lo:104: Request processed in 48us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.733143:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833708.733154:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833708.733160:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+7:8429:x1874679375620736:12345-0@lo:104: 00010000:00010000:1.0:1787833708.733168:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733198:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787833708.733203:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+7:8429:x1874679375620736:12345-0@lo:104: Request processed in 44us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.733209:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833708.733222:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787833708.733227:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+6:8429:x1874679375620864:12345-0@lo:104: 00010000:00010000:1.0:1787833708.733235:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733266:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787833708.733271:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+6:8429:x1874679375620864:12345-0@lo:104: Request processed in 44us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.733277:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787833708.733288:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787833708.733293:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:8429:x1874679375620992:12345-0@lo:104: 00010000:00010000:1.0:1787833708.733301:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733324:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787833708.733329:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:8429:x1874679375620992:12345-0@lo:104: Request processed in 36us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.733335:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787833708.733507:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6452888b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620480:0@lo:104: 00000100:00100000:0.0:1787833708.733517:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620608:0@lo:104: 00000100:00100000:0.0:1787833708.733525:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620736:0@lo:104: 00000100:00100000:0.0:1787833708.733531:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620864:0@lo:104: 00000100:00100000:0.0:1787833708.733538:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64528883c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620992:0@lo:104: 00000100:00100000:1.0:1787833708.733623:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787833708.733629:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:8429:x1874679375621120:12345-0@lo:104: 00010000:00010000:1.0:1787833708.733638:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733669:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787833708.733674:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:8429:x1874679375621120:12345-0@lo:104: Request processed in 46us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.733680:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787833708.733691:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787833708.733697:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:8429:x1874679375621248:12345-0@lo:104: 00010000:00010000:1.0:1787833708.733705:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733736:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787833708.733741:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:8429:x1874679375621248:12345-0@lo:104: Request processed in 45us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833708.733748:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787833708.733780:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787833708.733788:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733797:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198400 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833708.733802:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733813:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833708.733822:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833708.733830:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833708.733869:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733877:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833708.733899:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733907:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462198400/0x2bdb54ee5e774c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733932:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787833708.733936:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733943:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c000 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833708.733946:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733954:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833708.733962:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833708.733967:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833708.733979:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733986:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833708.733991:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.733999:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c000/0x2bdb54ee5e774c66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c6d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734007:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787833708.734010:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734026:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82200 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833708.734029:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734036:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833708.734043:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833708.734049:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833708.734060:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734065:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833708.734081:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734088:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82200/0x2bdb54ee5e774c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c51 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734101:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787833708.734104:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734111:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82600 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833708.734114:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734132:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833708.734139:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833708.734145:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833708.734158:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734164:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833708.734169:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734177:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82600/0x2bdb54ee5e774c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734186:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787833708.734189:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734195:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440030000 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833708.734199:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734206:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833708.734213:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833708.734224:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833708.734237:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734243:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833708.734247:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734255:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734264:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787833708.734267:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734274:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833708.734277:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734285:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833708.734292:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833708.734298:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833708.734308:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734314:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833708.734324:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833708.734330:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2de00/0x2bdb54ee5e774c04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774c0b expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833708.734476:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375621120:0@lo:104: 00000100:00100000:0.0:1787833708.734486:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6452889680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375621248:0@lo:104: 00000100:00100000:0.0:1787833708.734922:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375621376:0@lo:103: 00000100:00100000:0.0:1787833708.734985:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833708.735038:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375621888:0@lo:103: 00000100:00100000:0.0:1787833708.735059:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833708.735084:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787833708.735089:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375621504:0@lo:103: 00000100:00100000:0.0:1787833708.735108:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833708.735131:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375622016:0@lo:103: 00000100:00100000:0.0:1787833708.735154:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833708.735180:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833708.735187:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.735195:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833708.735198:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.735206:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833708.735222:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833708.735228:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787833708.735257:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.735263:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833708.735269:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.735275:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e774bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774be1 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.735292:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833708.735293:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833708.735295:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833708.735301:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833708.735315:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375621376 00000100:00100000:0.0:1787833708.735321:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375621376 00000100:00100000:2.0:1787833708.735505:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375621888 00000100:00100000:2.0:1787833708.735510:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375621888 00010000:00010000:2.0:1787833708.735537:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c2e expref: 20 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833708.735582:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375621504 00000100:00100000:2.0:1787833708.735585:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375621504 00010000:00010000:2.0:1787833708.735597:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c66 expref: 21 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833708.735606:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375622016 00000100:00100000:2.0:1787833708.735608:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375622016 00010000:00010000:2.0:1787833708.735616:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c04 expref: 22 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833708.735627:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833708.735635:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+22:3282:x1874679375621888:12345-0@lo:103: 00010000:00010000:2.0:1787833708.735648:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833708.735653:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c2e expref: 22 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.735663:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c2e expref: 22 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.735680:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e774c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774c2e expref: 22 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.735696:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833708.735740:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+21:3282:x1874679375621888:12345-0@lo:103: Request processed in 106us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.735748:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833708.735765:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833708.735771:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+20:3282:x1874679375621504:12345-0@lo:103: 00010000:00010000:2.0:1787833708.735787:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833708.735792:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c66 expref: 20 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.735801:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c66 expref: 20 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.735811:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83200/0x2bdb54ee5e774c6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774c66 expref: 20 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.735820:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833708.735856:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375621504:12345-0@lo:103: Request processed in 85us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.735863:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787833708.735875:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787833708.735881:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3282:x1874679375622016:12345-0@lo:103: 00010000:00010000:2.0:1787833708.735890:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833708.735895:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c04 expref: 18 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.735904:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c04 expref: 18 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.735915:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e774c0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774c04 expref: 18 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.735925:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833708.735946:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:3282:x1874679375622016:12345-0@lo:103: Request processed in 66us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.735965:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787833708.736003:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375621504:0@lo:103: 00000100:00100000:2.0:1787833708.736014:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375622016:0@lo:103: 00000100:00100000:2.0:1787833708.736022:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375621888:0@lo:103: 00000100:00100000:2.0:1787833708.736468:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375621760:0@lo:103: 00000100:00100000:2.0:1787833708.736504:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833708.736530:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787833708.736537:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375621632:0@lo:103: 00000100:00100000:2.0:1787833708.736569:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833708.736580:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375622144:0@lo:103: 00000100:00100000:2.0:1787833708.736600:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833708.736625:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375621760 00000100:00100000:2.0:1787833708.736630:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375621760 00010000:00010000:2.0:1787833708.736652:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c3c expref: 17 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833708.736668:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375621632 00000100:00100000:2.0:1787833708.736670:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375621632 00010000:00010000:2.0:1787833708.736680:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c4a expref: 18 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833708.736690:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375622144 00000100:00100000:2.0:1787833708.736692:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375622144 00010000:00010000:2.0:1787833708.736701:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774bda expref: 19 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833708.736712:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787833708.736726:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375621760:12345-0@lo:103: 00010000:00010000:2.0:1787833708.736735:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833708.736740:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c3c expref: 19 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.736749:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c3c expref: 19 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.736762:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774c3c expref: 19 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.736773:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833708.736803:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3281:x1874679375621760:12345-0@lo:103: Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.736810:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787833708.736823:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787833708.736829:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:3281:x1874679375621632:12345-0@lo:103: 00010000:00010000:2.0:1787833708.736838:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833708.736843:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c4a expref: 17 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.736851:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c4a expref: 17 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.736862:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774c4a expref: 17 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.736870:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833708.736893:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3281:x1874679375621632:12345-0@lo:103: Request processed in 64us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.736909:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787833708.736921:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787833708.736928:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446009450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:3281:x1874679375622144:12345-0@lo:103: 00010000:00010000:2.0:1787833708.736936:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833708.736941:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774bda expref: 15 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.736950:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774bda expref: 15 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.736961:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83c00/0x2bdb54ee5e774be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774bda expref: 15 pid: 5807 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.736970:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833708.736993:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446009450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:3281:x1874679375622144:12345-0@lo:103: Request processed in 66us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.736999:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787833708.737028:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375621632:0@lo:103: 00000100:00100000:2.0:1787833708.737037:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375622144:0@lo:103: 00000100:00100000:2.0:1787833708.737044:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375621760:0@lo:103: 00010000:00010000:0.0:1787833708.737295:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c90 expref: 13 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833708.737325:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787833708.737333:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:3282:x1874679375621376:12345-0@lo:103: 00010000:00010000:0.0:1787833708.737362:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833708.737366:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c90 expref: 13 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.737388:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774c90 expref: 13 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.737400:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c82a00/0x2bdb54ee5e774c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774c90 expref: 13 pid: 5809 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.737411:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833708.737447:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:3282:x1874679375621376:12345-0@lo:103: Request processed in 116us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833708.737454:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787833708.737633:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833708.737637:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833708.737639:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833708.737774:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375621376:0@lo:103: 00000100:00100000:1.0:1787833708.742961:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833708.742997:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833708.743070:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367209600 00000100:00100000:2.0:1787833708.743083:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367209600 00010000:00010000:2.0:1787833708.743137:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3954 expref: 10 pid: 5807 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833708.743204:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367209472 00000100:00100000:2.0:1787833708.743207:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367209472 00010000:00010000:2.0:1787833708.743222:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe395b expref: 11 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833708.743238:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:2.0:1787833708.743249:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+11:2344:x1874679367209600:12345-192.168.202.15@tcp:103: 00010000:00010000:2.0:1787833708.743267:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833708.743274:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3954 expref: 11 pid: 5807 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743288:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3954 expref: 11 pid: 5807 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743319:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833708.743421:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+11:2344:x1874679367209600:12345-192.168.202.15@tcp:103: Request processed in 172us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.743428:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:2.0:1787833708.743449:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:2.0:1787833708.743456:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367209472:12345-192.168.202.15@tcp:103: 00010000:00010000:2.0:1787833708.743463:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833708.743468:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe395b expref: 10 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743477:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe395b expref: 10 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743503:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743512:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743530:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743538:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743545:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743563:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743570:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833708.743574:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743583:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743593:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833708.743605:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833708.743628:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367209472:12345-192.168.202.15@tcp:103: Request processed in 172us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833708.743644:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00010000:00010000:0.0:1787833708.743816:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe395b expref: 9 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833708.743834:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6452888780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620224:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833708.743847:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83e00/0x2bdb54ee5e774ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3954 expref: 8 pid: 5807 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833708.743856:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6452889a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874679375620352:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833708.743909:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.743921:0:8429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.743927:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.743932:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774ce4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833708.860561:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833709.886413:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787833709.948753:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787833709.948765:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b647fa63000 from 39 10000000:01000000:2.0:1787833709.948773:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833709.948840:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833709.948856:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833709.948871:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833709.948905:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375622272:0@lo:101: 00000100:00100000:2.0:1787833709.949004:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833709.949089:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442f5b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833709.949237:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375622272 00000100:00100000:0.0:1787833709.949247:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375622272 00000100:00100000:0.0:1787833709.949319:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787833709.949331:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+12:5812:x1874679375622272:12345-0@lo:101: 00010000:00010000:0.0:1787833709.949372:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833709.949392:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774ceb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833709.949422:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774ceb expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833709.949434:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774ceb expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833709.949445:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440030600, rc 0) 00000100:00100000:0.0:1787833709.949504:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375622272:12345-0@lo:101: Request processed in 176us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833709.949512:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787833709.949632:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375622272:0@lo:101: 00010000:00010000:2.0:1787833709.949650:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833709.949661:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833709.949727:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375622400:0@lo:501: 00000100:00100000:2.0:1787833709.949755:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833709.949791:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442f5b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833709.949904:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375622400 00000100:00100000:3.0:1787833709.949910:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375622400 00000100:00100000:3.0:1787833709.949969:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787833709.949976:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375622400:12345-0@lo:501: 00000100:00100000:3.0:1787833709.950503:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375622400:12345-0@lo:501: Request processed in 525us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833709.950514:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787833709.951433:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375622400:0@lo:501: 00000100:00100000:2.0:1787833709.951494:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375622528:0@lo:503: 00000100:00100000:2.0:1787833709.951583:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833709.951625:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442f5b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833709.951802:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375622528 00000100:00100000:3.0:1787833709.951809:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375622528 00000100:00100000:3.0:1787833709.951862:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787833709.951872:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375622528:12345-0@lo:503: 00000100:00100000:3.0:1787833709.952085:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375622528:12345-0@lo:503: Request processed in 215us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833709.952094:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787833709.952238:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375622528:0@lo:503: 00000100:00100000:1.0:1787833709.959055:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8445:1874679375622656:0@lo:502: 00000100:00100000:1.0:1787833709.959188:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833709.959417:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833709.965878:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375622656 00000100:00100000:3.0:1787833709.965902:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375622656 00000100:00100000:3.0:1787833709.965988:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787833709.966001:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:8445:x1874679375622656:12345-0@lo:502: 00000100:00100000:3.0:1787833709.966512:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:8445:x1874679375622656:12345-0@lo:502: Request processed in 512us (7322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833709.966522:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787833709.970871:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8445:1874679375622656:0@lo:502: 00000100:00100000:1.0:1787833709.970991:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8445:1874679375622784:0@lo:502: 00000100:00100000:1.0:1787833709.971102:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833709.971176:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452ea73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833709.974422:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375622784 00000100:00100000:0.0:1787833709.974443:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375622784 00000100:00100000:0.0:1787833709.974550:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787833709.974564:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:8445:x1874679375622784:12345-0@lo:502: 00000100:00100000:0.0:1787833709.974984:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:8445:x1874679375622784:12345-0@lo:502: Request processed in 422us (3881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833709.974993:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787833709.975579:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8445:1874679375622784:0@lo:502: 00000040:00080000:1.0:1787833709.975631:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787833709.975786:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787833709.975816:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787833709.975831:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833709.975844:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833709.975856:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787833709.975859:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787833709.975863:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787833709.975907:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833709.975916:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833709.975928:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833709.975951:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375622912:0@lo:101: 00000100:00100000:2.0:1787833709.976010:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833709.976142:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833709.978986:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375622912 00000100:00100000:3.0:1787833709.979010:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375622912 00000100:00100000:3.0:1787833709.979092:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787833709.979112:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+13:5812:x1874679375622912:12345-0@lo:101: 00010000:00010000:3.0:1787833709.979134:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833709.979158:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2da00/0x2bdb54ee5e774d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774cf9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833709.979195:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2da00/0x2bdb54ee5e774d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774cf9 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833709.979374:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2da00/0x2bdb54ee5e774d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774cf9 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833709.979384:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2da00, rc 0) 00000100:00100000:3.0:1787833709.979484:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375622912:12345-0@lo:101: Request processed in 382us (3475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833709.979491:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787833709.979647:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375622912:0@lo:101: 00010000:00010000:2.0:1787833709.979680:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833709.979698:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833709.979787:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623040:0@lo:501: 00000100:00100000:2.0:1787833709.979823:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833709.979892:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833709.980639:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375623040 00000100:00100000:0.0:1787833709.980652:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375623040 00000100:00100000:0.0:1787833709.980713:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787833709.981194:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375623040:12345-0@lo:501: 00000100:00100000:0.0:1787833709.982156:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375623040:12345-0@lo:501: Request processed in 1428us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833709.982169:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787833709.986686:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623040:0@lo:501: 00000100:00100000:2.0:1787833709.987064:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623168:0@lo:503: 00000100:00100000:2.0:1787833709.987896:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833709.987962:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833709.988648:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375623168 00000100:00100000:3.0:1787833709.988661:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375623168 00000100:00100000:3.0:1787833709.989821:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787833709.989846:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375623168:12345-0@lo:503: 00000100:00100000:3.0:1787833709.990705:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375623168:12345-0@lo:503: Request processed in 865us (2806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833709.990782:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787833709.990930:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623168:0@lo:503: 00000100:00100000:2.0:1787833709.991324:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8446:1874679375623296:0@lo:502: 00000100:00100000:2.0:1787833709.991411:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833709.998995:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.006909:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375623296 00000100:00100000:0.0:1787833710.006930:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375623296 00000100:00100000:0.0:1787833710.007018:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787833710.007030:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:8446:x1874679375623296:12345-0@lo:502: 00000100:00100000:0.0:1787833710.009265:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:8446:x1874679375623296:12345-0@lo:502: Request processed in 2223us (17840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.009284:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787833710.012655:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8446:1874679375623296:0@lo:502: 00000020:01000000:2.0:1787833710.012757:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833710.012780:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833710.012784:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787833710.012792:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787833710.012850:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8446:1874679375623424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833710.012979:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833710.013044:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b644564e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833710.013698:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375623424 00000100:00100000:3.0:1787833710.013710:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375623424 00000100:00100000:3.0:1787833710.013790:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787833710.013801:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:8446:x1874679375623424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833710.014145:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:8446:x1874679375623424:12345-0@lo:502:llog_process_th.0 Request processed in 345us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833710.014155:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787833710.014562:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8446:1874679375623424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787833710.014602:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833710.014619:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833710.014621:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787833710.014627:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787833710.016030:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787833710.016069:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787833710.016097:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833710.018224:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833710.018241:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787833710.018245:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b64773a1800 from 39 10000000:01000000:3.0:1787833710.018249:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787833710.018299:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833710.018308:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833710.018322:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833710.018668:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6452888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833710.018781:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833710.018891:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833710.025176:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375623552 00000100:00100000:1.0:1787833710.025200:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375623552 00000100:00100000:3.0:1787833710.030938:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787833710.030958:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:5812:x1874679375623552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833710.030986:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833710.031013:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2d800/0x2bdb54ee5e774d0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774d07 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833710.031058:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2d800/0x2bdb54ee5e774d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d07 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833710.031073:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2d800/0x2bdb54ee5e774d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d07 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833710.031105:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2d800, rc 0) 00000100:00100000:3.0:1787833710.031230:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375623552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 276us (12449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833710.031238:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787833710.031371:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6452888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833710.031552:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.031564:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833710.031669:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833710.031715:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833710.046969:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.050814:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375623680 00000100:00100000:0.0:1787833710.050838:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375623680 00000100:00100000:0.0:1787833710.050974:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787833710.050987:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375623680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.051478:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375623680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 492us (19760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.051488:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787833710.051714:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.051782:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.051843:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.051879:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b646dd8ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.051895:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375623808 00000100:00100000:0.0:1787833710.051907:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375623808 00000100:00100000:0.0:1787833710.051937:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787833710.051944:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375623808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.052135:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375623808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.052142:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787833710.052185:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375623808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.052998:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8447:1874679375623936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.053059:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.053135:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b646dd8c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787833710.061800:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375623936 00000100:00100000:1.0:1787833710.061819:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375623936 00000100:00100000:1.0:1787833710.061948:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787833710.061960:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:8447:x1874679375623936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833710.062335:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:8447:x1874679375623936:12345-0@lo:502:llog_process_th.0 Request processed in 376us (9275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833710.062371:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787833710.062490:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8447:1874679375623936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833710.062590:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8447:1874679375624064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833710.062642:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833710.063928:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.068696:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375624064 00000100:00100000:0.0:1787833710.068719:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375624064 00000100:00100000:0.0:1787833710.068812:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787833710.068825:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:8447:x1874679375624064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.069297:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:8447:x1874679375624064:12345-0@lo:502:llog_process_th.0 Request processed in 473us (6653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.069307:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787833710.070683:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8447:1874679375624064:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787833710.070748:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787833710.075023:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787833710.075079:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787833710.075095:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.075111:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833710.075124:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787833710.075128:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787833710.075153:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787833710.075205:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.075214:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.075227:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833710.075255:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.075655:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.075754:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b646dd8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833710.077367:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375624192 00000100:00100000:2.0:1787833710.077383:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375624192 00000100:00100000:2.0:1787833710.077556:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787833710.077569:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:5812:x1874679375624192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833710.077592:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833710.077615:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e774d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774d15 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.077675:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e774d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d15 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.077689:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e774d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d15 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.077699:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c82e00, rc 0) 00000100:00100000:2.0:1787833710.077793:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375624192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833710.077801:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787833710.077908:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833710.077929:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.077940:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833710.078024:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.078058:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.079419:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b646dd8c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833710.083122:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375624320 00000100:00100000:1.0:1787833710.083145:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375624320 00000100:00100000:1.0:1787833710.083221:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787833710.083234:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375624320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833710.083840:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375624320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 606us (5778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833710.083851:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787833710.084002:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.084075:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.084140:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.084185:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b646dd8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833710.084270:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375624448 00000100:00100000:2.0:1787833710.084277:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375624448 00000100:00100000:2.0:1787833710.084314:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787833710.084323:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375624448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.084697:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.085014:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8448:1874679375624576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.085062:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.085086:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225300 going to sleep for 11 seconds 00000100:00100000:2.0:1787833710.085132:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375624448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833710.085143:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787833710.085182:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375624576 00000100:00100000:2.0:1787833710.085186:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375624576 00000100:00100000:2.0:1787833710.085209:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787833710.085216:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:8448:x1874679375624576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833710.085426:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:8448:x1874679375624576:12345-0@lo:502:llog_process_th.0 Request processed in 208us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833710.085433:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787833710.085524:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8448:1874679375624576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833710.085572:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833710.085584:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833710.085587:0:8448:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787833710.085595:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787833710.085619:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8448:1874679375624704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.085654:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.085685:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225300 going to sleep for 11 seconds 00000100:00100000:2.0:1787833710.085800:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375624704 00000100:00100000:2.0:1787833710.085805:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375624704 00000100:00100000:2.0:1787833710.085834:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787833710.085841:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:8448:x1874679375624704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833710.085976:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:8448:x1874679375624704:12345-0@lo:502:llog_process_th.0 Request processed in 134us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833710.085983:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787833710.086945:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8448:1874679375624704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833710.086981:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833710.086989:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833710.086991:0:8448:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787833710.086997:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787833710.087188:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787833710.087216:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787833710.087230:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.087242:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833710.087254:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787833710.087257:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6460630000 from 39 10000000:01000000:2.0:1787833710.087260:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833710.087295:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.087304:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.087314:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833710.087336:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787833710.087415:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833710.087451:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442f5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.087593:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375624832 00000100:00100000:0.0:1787833710.087600:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375624832 00000100:00100000:0.0:1787833710.087651:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787833710.087660:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375624832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833710.087674:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833710.087689:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774d2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774d23 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.087719:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d23 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.087753:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d23 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.087763:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031000, rc 0) 00000100:00100000:0.0:1787833710.087805:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375624832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.087812:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787833710.087969:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833710.087991:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.088001:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833710.088054:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833710.088082:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833710.088102:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442f5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.088251:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375624960 00000100:00100000:0.0:1787833710.088256:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375624960 00000100:00100000:0.0:1787833710.088285:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787833710.088291:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375624960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.088904:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375624960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 610us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.088913:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787833710.094736:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375624960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.100255:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375625088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.100507:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833710.100671:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375625088 00000100:00100000:2.0:1787833710.100681:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375625088 00000100:00100000:2.0:1787833710.100756:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787833710.100769:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375625088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833710.101040:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375625088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833710.101051:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787833710.101205:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64462253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.101234:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375625088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.102846:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8449:1874679375625216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.102944:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.102999:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833710.103558:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375625216 00000100:00100000:3.0:1787833710.103569:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375625216 00000100:00100000:3.0:1787833710.103634:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787833710.103645:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:8449:x1874679375625216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833710.103978:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:8449:x1874679375625216:12345-0@lo:502:llog_process_th.0 Request processed in 334us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833710.103987:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787833710.104222:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8449:1874679375625216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.104290:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8449:1874679375625344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.104387:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.104423:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833710.104486:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375625344 00000100:00100000:2.0:1787833710.104501:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375625344 00000100:00100000:2.0:1787833710.104532:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787833710.104552:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:8449:x1874679375625344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833710.104744:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:8449:x1874679375625344:12345-0@lo:502:llog_process_th.0 Request processed in 193us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833710.104752:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787833710.104877:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8449:1874679375625344:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787833710.104901:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787833710.105118:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787833710.105141:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787833710.105163:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.105177:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833710.105191:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787833710.105194:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787833710.105198:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787833710.105232:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.105242:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833710.105254:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833710.105271:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375625472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787833710.105308:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833710.105378:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442f5b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.105437:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375625472 00000100:00100000:0.0:1787833710.105443:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375625472 00000100:00100000:0.0:1787833710.105484:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787833710.105500:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375625472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833710.105512:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833710.105529:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440031400/0x2bdb54ee5e774d38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774d31 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.105576:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440031400/0x2bdb54ee5e774d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d31 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.105588:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440031400/0x2bdb54ee5e774d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d31 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.105597:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031400, rc 0) 00000100:00100000:0.0:1787833710.105638:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375625472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.105645:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787833710.105682:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375625472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833710.105697:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.105707:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833710.105774:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375625600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.105803:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.105822:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375625600 00000100:00100000:0.0:1787833710.105826:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375625600 00000100:00100000:0.0:1787833710.105844:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787833710.105851:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375625600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.106170:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375625600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.106180:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787833710.106218:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.106233:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375625600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.106262:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375625728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.106301:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.106321:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375625728 00000100:00100000:0.0:1787833710.106325:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375625728 00000100:00100000:0.0:1787833710.106384:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787833710.106394:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375625728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.106611:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375625728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.106618:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787833710.106653:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225780 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.106665:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375625728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.106908:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8450:1874679375625856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.106951:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.106979:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375625856 00000100:00100000:0.0:1787833710.106983:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375625856 00000100:00100000:0.0:1787833710.107004:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787833710.107010:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8450:x1874679375625856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.107179:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8450:x1874679375625856:12345-0@lo:502:llog_process_th.0 Request processed in 168us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.107187:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787833710.107219:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.107232:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8450:1874679375625856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833710.107258:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833710.107270:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833710.107273:0:8450:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787833710.107281:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787833710.107303:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8450:1874679375625984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.107337:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.107385:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375625984 00000100:00100000:0.0:1787833710.107388:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375625984 00000100:00100000:0.0:1787833710.107406:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787833710.107412:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8450:x1874679375625984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833710.107527:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8450:x1874679375625984:12345-0@lo:502:llog_process_th.0 Request processed in 113us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.107549:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787833710.107578:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452de5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.107590:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8450:1874679375625984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833710.107609:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833710.107619:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833710.107621:0:8450:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787833710.107625:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787833710.107685:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787833710.107710:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787833710.107721:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.107732:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833710.107743:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787833710.107746:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6443fdced8 from 1 10000000:01000000:0.0:1787833710.107750:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787833710.107776:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.107784:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.107795:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833710.107812:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375626112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.107840:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.107853:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452de5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.107867:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375626112 00000100:00100000:0.0:1787833710.107870:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375626112 00000100:00100000:0.0:1787833710.107890:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787833710.107896:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375626112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833710.107917:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833710.107932:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440030800/0x2bdb54ee5e774d46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774d3f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.107956:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440030800/0x2bdb54ee5e774d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d3f expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.107968:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440030800/0x2bdb54ee5e774d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d3f expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.107979:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440030800, rc 0) 00000100:00100000:0.0:1787833710.108010:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375626112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.108018:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787833710.108048:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375626112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833710.108062:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d46 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.108072:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d46 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833710.108117:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375626240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.108141:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.108154:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452de5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833710.108164:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375626240 00000100:00100000:0.0:1787833710.108167:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375626240 00000100:00100000:0.0:1787833710.108184:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787833710.108190:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375626240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833710.108448:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375626240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (306us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833710.108457:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787833710.108486:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375626240:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787833710.108507:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787833710.108513:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d46 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.108520:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d46 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833710.142029:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375626368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833710.142138:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833710.142405:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375626368 00000100:00100000:0.0:1787833710.142416:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375626368 00000100:00100000:0.0:1787833710.142558:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787833710.142571:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375626368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833710.142619:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833710.142698:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375626368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.142707:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787833710.142882:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734de00 x1874679375626368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833710.142907:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375626368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787833710.142952:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833710.192263:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833710.195580:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367209728 00000100:00100000:0.0:1787833710.195608:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367209728 00000100:00100000:0.0:1787833710.196001:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:0.0:1787833710.196015:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+8:5589:x1874679367209728:12345-192.168.202.15@tcp:101: 00010000:00010000:0.0:1787833710.196546:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833710.196592:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe39bd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.196634:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39bd expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.196650:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39bd expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.196662:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440030c00, rc 0) 00000100:00100000:0.0:1787833710.196749:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5589:x1874679367209728:12345-192.168.202.15@tcp:101: Request processed in 737us (4501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.196759:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:1.0:1787833710.209259:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833710.209391:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367209856 00000100:00100000:3.0:1787833710.209405:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367209856 00000100:00100000:3.0:1787833710.209482:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:3.0:1787833710.209494:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5589:x1874679367209856:12345-192.168.202.15@tcp:501: 00000100:00100000:3.0:1787833710.210137:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5589:x1874679367209856:12345-192.168.202.15@tcp:501: Request processed in 643us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833710.210148:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:1.0:1787833710.232399:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833710.232550:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367209984 00000100:00100000:0.0:1787833710.232564:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367209984 00000100:00100000:0.0:1787833710.232644:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:0.0:1787833710.232655:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5589:x1874679367209984:12345-192.168.202.15@tcp:503: 00000100:00100000:0.0:1787833710.232986:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5589:x1874679367209984:12345-192.168.202.15@tcp:503: Request processed in 331us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.232996:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:2.0:1787833710.239554:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833710.239949:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367210112 00000100:00100000:3.0:1787833710.239964:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367210112 00000100:00100000:3.0:1787833710.240029:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:3.0:1787833710.240042:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+9:6060:x1874679367210112:12345-192.168.202.15@tcp:502: 00000100:00100000:3.0:1787833710.242413:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+9:6060:x1874679367210112:12345-192.168.202.15@tcp:502: Request processed in 2358us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833710.242431:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:1.0:1787833710.255566:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833710.255836:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367210240 00000100:00100000:2.0:1787833710.255851:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367210240 00000100:00100000:2.0:1787833710.255927:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:2.0:1787833710.256014:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+9:6060:x1874679367210240:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833710.256445:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+9:6060:x1874679367210240:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 433us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833710.256463:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:1.0:1787833710.267745:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833710.268175:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367210368 00000100:00100000:0.0:1787833710.268189:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367210368 00000100:00100000:0.0:1787833710.268261:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:0.0:1787833710.268273:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5589:x1874679367210368:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833710.268297:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833710.268320:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440031200/0x2bdb54ee5e774d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe39c4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.268429:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440031200/0x2bdb54ee5e774d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39c4 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.268444:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440031200/0x2bdb54ee5e774d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39c4 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833710.268455:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031200, rc 0) 00000100:00100000:0.0:1787833710.268545:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5589:x1874679367210368:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 263us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833710.268554:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:0.0:1787833710.272689:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833710.273092:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367210496 00000100:00100000:2.0:1787833710.273109:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367210496 00000100:00100000:2.0:1787833710.273194:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 170 00000100:00100000:2.0:1787833710.273208:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5589:x1874679367210496:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833710.273703:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5589:x1874679367210496:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 496us (1030us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787833710.273714:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 170 00010000:00010000:1.0:1787833710.910726:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833711.939728:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787833712.040913:0:8488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce6242490 20000000:00000080:3.0:1787833712.040940:0:8488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b647f88c800 uarg=0000000000000000 20000000:01000000:3.0:1787833712.040987:0:8488:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787833712.040995:0:8488:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787833712.041001:0:8488:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787833712.053867:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787833712.056944:0:8488:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787833712.062241:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787833712.062317:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787833712.065041:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787833712.065096:0:8488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787833712.065131:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065157:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774ad0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065165:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774b2b expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065173:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774bf6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065185:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe398c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065193:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065256:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe398c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065299:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe398c expref: 9 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833712.065320:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874679375626496:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833712.065509:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774bf6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065531:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774bf6 expref: 18 pid: 5807 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833712.065543:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874679375626624:0@lo:104: 00000100:00100000:2.0:1787833712.065699:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833712.065840:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774b2b expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065849:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b2b expref: 18 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833712.065860:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874679375626752:0@lo:104: 00010000:00010000:2.0:1787833712.065897:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.065906:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 18 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833712.065915:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874679375626880:0@lo:104: 00000100:00100000:2.0:1787833712.065937:0:8488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444280540 going to sleep for 11 seconds 00000100:00100000:0.0:1787833712.070831:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787833712.070896:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833712.070985:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833712.075188:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375626624 00000100:00100000:3.0:1787833712.075209:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375626624 00000100:00100000:3.0:1787833712.075274:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375626752 00000100:00100000:3.0:1787833712.075278:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375626752 00000100:00100000:3.0:1787833712.075292:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375626880 00000100:00100000:3.0:1787833712.075295:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375626880 00000100:00100000:3.0:1787833712.075314:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787833712.075323:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647741c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:8488:x1874679375626624:12345-0@lo:104: 00010000:00010000:3.0:1787833712.075366:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.075489:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787833712.075496:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647741c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+5:8488:x1874679375626624:12345-0@lo:104: Request processed in 174us (9799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833712.075504:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787833712.076467:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833712.076538:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874679375626496:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833712.076541:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367210624 00000100:00100000:2.0:1787833712.076562:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367210624 00000100:00100000:1.0:1787833712.076567:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874679375626624:0@lo:104: 00010000:00010000:2.0:1787833712.076605:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe398c expref: 10 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833712.076649:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:2.0:1787833712.076658:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367210624:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833712.076674:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833712.076680:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe398c expref: 10 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.076694:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe398c expref: 10 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.076718:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462198c00/0x2bdb54ee5e774cba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe398c expref: 10 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.076736:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833712.076797:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+9:2344:x1874679367210624:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 140us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833712.076806:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00010000:00010000:1.0:1787833712.077417:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833712.077429:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833712.077441:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199a00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833712.077446:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833712.077457:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833712.077484:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833712.077491:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787833712.077514:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787833712.077541:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:8488:x1874679375626752:12345-0@lo:104: 00010000:00010000:1.0:1787833712.077560:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.077570:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833712.077570:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833712.077604:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833712.077612:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462199a00/0x2bdb54ee5e774bf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774bfd expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833712.077632:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833712.077635:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833712.077638:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833712.077657:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833712.077665:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:8488:x1874679375626752:12345-0@lo:104: Request processed in 129us (6774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833712.077678:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874679375626752:0@lo:104: 00000100:00100000:2.0:1787833712.077690:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787833712.077716:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833712.077723:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:8488:x1874679375626880:12345-0@lo:104: 00010000:00010000:2.0:1787833712.077732:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.077791:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787833712.077797:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:8488:x1874679375626880:12345-0@lo:104: Request processed in 76us (6812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833712.077803:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833712.077834:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375627008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833712.077881:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833712.077943:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787833712.077950:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.077958:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031800 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:2.0:1787833712.077961:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.077969:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833712.077976:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833712.077981:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787833712.078018:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078031:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833712.078048:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078055:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774b2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774b32 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078067:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833712.078070:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078076:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c600 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:2.0:1787833712.078079:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078086:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833712.078092:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833712.078098:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787833712.078113:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078120:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833712.078139:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078146:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774ad0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078166:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833712.078168:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833712.078170:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833712.078182:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375627008 00000100:00100000:2.0:1787833712.078187:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375627008 00010000:00010000:2.0:1787833712.078209:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774bf6 expref: 19 pid: 5807 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833712.078237:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833712.078248:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462315e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375627008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833712.078260:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833712.078264:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774bf6 expref: 19 pid: 5807 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078278:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774bf6 expref: 19 pid: 5807 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833712.078284:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874679375626880:0@lo:104: 00010000:00010000:2.0:1787833712.078314:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774bfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774bf6 expref: 19 pid: 5807 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078331:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833712.078376:0:8488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833712.078408:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462315e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3282:x1874679375627008:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833712.078417:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833712.078443:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375627264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833712.078491:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833712.078547:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375627264 00000100:00100000:2.0:1787833712.078551:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375627264 00010000:00010000:2.0:1787833712.078574:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 18 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833712.078602:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833712.078608:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3280:x1874679375627264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833712.078616:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833712.078619:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774ad0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 18 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078629:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 18 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078640:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774ad0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774ac9 expref: 18 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833712.078648:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833712.078686:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:3280:x1874679375627264:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833712.078694:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833712.078714:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375627136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833712.078719:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375627264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833712.078738:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833712.078751:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375627136 00000100:00100000:3.0:1787833712.078762:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375627136 00000100:00100000:2.0:1787833712.078773:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375627008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833712.078778:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b2b expref: 17 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833712.078804:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787833712.078810:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f939a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:3283:x1874679375627136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833712.078819:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833712.078823:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b2b expref: 17 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078833:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774b2b expref: 17 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078843:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774b32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774b2b expref: 17 pid: 5809 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078857:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078867:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078883:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078891:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078898:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078905:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078928:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833712.078933:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833712.078938:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833712.078941:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078958:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833712.078969:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833712.079009:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f939a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3283:x1874679375627136:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833712.079016:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787833712.079127:0:8488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833712.079139:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833712.079146:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774d5b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833712.079171:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375627136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833712.702238:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375627520:0@lo:400:kworker.0 00000100:00100000:2.0:1787833712.702317:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833712.702402:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375628032:0@lo:400:kworker.0 00000100:00100000:2.0:1787833712.702444:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833712.702648:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375627776:0@lo:400:kworker.0 00000100:00100000:0.0:1787833712.702681:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833712.702720:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787833712.702726:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f938b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375627392:0@lo:400:kworker.0 00000100:00100000:0.0:1787833712.702762:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833712.702787:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375627904:0@lo:400:kworker.0 00000100:00100000:0.0:1787833712.702809:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833712.702840:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375627392 00000100:00100000:0.0:1787833712.702849:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375627392 00000100:00100000:0.0:1787833712.702896:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787833712.702906:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3280:x1874679375627392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833712.702972:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3280:x1874679375627392:12345-0@lo:400:kworker.0 Request processed in 67us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833712.702980:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787833712.703026:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f938b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375627392:0@lo:400:kworker.0 00000100:00100000:1.0:1787833712.703322:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375628032 00000100:00100000:1.0:1787833712.703327:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375628032 00000100:00100000:1.0:1787833712.703386:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375627776 00000100:00100000:1.0:1787833712.703390:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375627776 00000100:00100000:1.0:1787833712.703411:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787833712.703418:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375628032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833712.703458:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375628032:12345-0@lo:400:kworker.0 Request processed in 41us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833712.703465:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787833712.703565:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833712.703573:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375627776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833712.703610:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375627776:12345-0@lo:400:kworker.0 Request processed in 38us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833712.703616:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833712.703638:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375627520 00000100:00100000:1.0:1787833712.703642:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375627520 00000100:00100000:1.0:1787833712.703667:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375627904 00000100:00100000:1.0:1787833712.703670:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375627904 00000100:00100000:1.0:1787833712.703689:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787833712.703695:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375627520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833712.703727:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375627520:12345-0@lo:400:kworker.0 Request processed in 32us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833712.703734:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787833712.703745:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787833712.703751:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375627904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833712.703779:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375627904:12345-0@lo:400:kworker.0 Request processed in 28us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833712.703794:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787833712.703811:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833712.703816:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833712.703818:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787833712.703855:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375627904:0@lo:400:kworker.0 00010000:00080000:1.0:1787833712.703869:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93a940 x1874679375627776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833712.703880:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375627776:0@lo:400:kworker.0 00000100:00100000:1.0:1787833712.706173:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375627648:0@lo:400:kworker.0 00000100:00100000:1.0:1787833712.706248:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833712.706300:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375627648 00000100:00100000:1.0:1787833712.706308:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375627648 00000100:00100000:1.0:1787833712.706391:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787833712.706402:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375627648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833712.706457:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375627648:12345-0@lo:400:kworker.0 Request processed in 57us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833712.706464:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787833712.706486:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787833712.706596:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93b0c0 x1874679375628032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833712.706610:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375628032:0@lo:400:kworker.0 00000100:00100000:2.0:1787833712.706637:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375627520:0@lo:400:kworker.0 00000100:00100000:1.0:1787833712.711001:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375627648:0@lo:400:kworker.0 00010000:00010000:1.0:1787833712.956711:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833713.214045:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375628160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833713.214121:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833713.216052:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375628160 00000100:00100000:0.0:1787833713.216066:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375628160 00000100:00100000:0.0:1787833713.216125:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787833713.216135:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375628160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833713.216174:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833713.220231:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375628160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4085us (6098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833713.220255:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787833713.220383:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734cb40 x1874679375628160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833713.220410:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375628160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833713.843396:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833713.843486:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367210752 00000100:00100000:0.0:1787833713.843497:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367210752 00000100:00100000:0.0:1787833713.843567:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:0.0:1787833713.843579:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+9:2344:x1874679367210752:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833713.843652:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+9:2344:x1874679367210752:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833713.843660:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:0.0:1787833713.846669:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833713.846737:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833713.846766:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833713.846893:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367210880 00000100:00100000:2.0:1787833713.846966:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367210880 00000100:00100000:2.0:1787833713.847068:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787833713.847079:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367210880:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833713.847150:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367210880:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 73us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833713.847157:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00080000:0.0:1787833713.848653:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833713.849424:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367211136 00000100:00100000:2.0:1787833713.849435:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367211136 00000100:00100000:2.0:1787833713.849548:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367211008 00000100:00100000:2.0:1787833713.849552:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367211008 00000100:00100000:2.0:1787833713.849582:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:2.0:1787833713.849593:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367211136:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833713.849669:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367211136:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 78us (2931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833713.849677:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:2.0:1787833713.849694:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787833713.849701:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367211008:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833713.849725:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367211008:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833713.849731:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00080000:0.0:1787833713.852472:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833713.852490:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787833713.982057:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833714.034972:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833714.035086:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367211264 00000100:00100000:2.0:1787833714.035096:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367211264 00000100:00100000:2.0:1787833714.035159:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:2.0:1787833714.035171:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+9:5589:x1874679367211264:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833714.035192:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833714.035226:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe39cb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.035255:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39cb expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.035268:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39cb expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.035277:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83600, rc 0) 00000100:00100000:2.0:1787833714.035368:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5589:x1874679367211264:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 199us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833714.035377:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:2.0:1787833714.038455:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833714.038523:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367211392 00000100:00100000:1.0:1787833714.038534:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367211392 00000100:00100000:1.0:1787833714.038698:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:1.0:1787833714.038723:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5589:x1874679367211392:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833714.039423:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5589:x1874679367211392:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 699us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833714.040067:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:2.0:1787833714.042233:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833714.042291:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367211520 00000100:00100000:0.0:1787833714.042300:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367211520 00000100:00100000:0.0:1787833714.042377:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:0.0:1787833714.042388:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5589:x1874679367211520:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833714.042660:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:5589:x1874679367211520:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 272us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.042669:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 175 10000000:01000000:0.0:1787833714.049205:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787833714.049216:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b647fa63000 from 4 10000000:01000000:0.0:1787833714.049233:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787833714.049278:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.049291:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.049302:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833714.049330:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375628288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787833714.049429:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.049516:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833714.049517:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64468b5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833714.049553:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375628288 00000100:00100000:1.0:1787833714.049562:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375628288 00000100:00100000:1.0:1787833714.049622:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367211648 00000100:00100000:1.0:1787833714.049625:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367211648 00000100:00100000:1.0:1787833714.049641:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787833714.049650:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375628288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833714.049666:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833714.049681:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774d69 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.049708:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d69 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.049718:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d69 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.049728:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198000, rc 0) 00000100:00100000:1.0:1787833714.049773:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375628288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833714.049780:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787833714.049810:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:1.0:1787833714.049816:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:6123:x1874679367211648:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787833714.050747:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:6123:x1874679367211648:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 925us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833714.050758:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:1.0:1787833714.050810:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375628288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833714.050830:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833714.050841:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833714.050912:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375628416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833714.050947:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.051095:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375628416 00000100:00100000:0.0:1787833714.051101:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375628416 00000100:00100000:0.0:1787833714.051135:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787833714.051143:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375628416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833714.051413:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375628416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.051422:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787833714.056332:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833714.056386:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833714.056420:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375628416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833714.056476:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375628544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833714.056555:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.057255:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.057305:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367211776 00000100:00100000:3.0:1787833714.057312:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367211776 00000100:00100000:3.0:1787833714.057833:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375628544 00000100:00100000:3.0:1787833714.057839:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375628544 00000100:00100000:3.0:1787833714.057864:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 179 00000100:00100000:3.0:1787833714.057874:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:6123:x1874679367211776:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787833714.058150:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:6123:x1874679367211776:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 276us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.058158:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 179 00000100:00100000:3.0:1787833714.058188:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787833714.058195:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375628544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.058316:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375628544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.058332:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787833714.058711:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375628544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833714.059323:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8574:1874679375628672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833714.059658:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.059726:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.059762:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375628672 00000100:00100000:3.0:1787833714.059767:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375628672 00000100:00100000:3.0:1787833714.059837:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787833714.059848:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:8574:x1874679375628672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833714.060199:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:8574:x1874679375628672:12345-0@lo:502:llog_process_th.0 Request processed in 353us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.060209:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787833714.060303:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8574:1874679375628672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833714.060335:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833714.060416:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833714.060418:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787833714.060424:0:8574:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b647fa63000 00000020:00000080:1.0:1787833714.060652:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787833714.060745:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8574:1874679375628800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833714.060786:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833714.060849:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.060885:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375628800 00000100:00100000:3.0:1787833714.060890:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375628800 00000100:00100000:3.0:1787833714.061089:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787833714.061174:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:8574:x1874679375628800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833714.061386:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:8574:x1874679375628800:12345-0@lo:502:llog_process_th.0 Request processed in 288us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.061394:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787833714.061705:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8574:1874679375628800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833714.061731:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833714.061737:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833714.061739:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787833714.061742:0:8574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787833714.061906:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787833714.061923:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833714.061934:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.061945:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833714.061955:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833714.061958:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b64773a1800 from 4 10000000:01000000:3.0:1787833714.062029:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833714.062059:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.062068:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.062077:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.062094:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375628928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.062204:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.062238:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833714.062282:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375628928 00000100:00100000:1.0:1787833714.062287:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375628928 00000100:00100000:3.0:1787833714.064682:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787833714.064706:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375628928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833714.064726:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833714.064745:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774d77 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.064778:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d77 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.064790:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d77 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.064799:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c200, rc 0) 00000100:00100000:3.0:1787833714.064879:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375628928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.064887:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787833714.064978:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375628928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833714.064999:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.065010:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.067685:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.067766:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.067813:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.067840:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375629056 00000100:00100000:3.0:1787833714.067847:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375629056 00000100:00100000:3.0:1787833714.067888:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787833714.067897:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375629056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.070368:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375629056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2462us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.070382:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787833714.070462:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.072708:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.072795:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.072837:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.085535:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375629184 00000100:00100000:3.0:1787833714.085548:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375629184 00000100:00100000:3.0:1787833714.085736:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787833714.085748:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375629184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.086024:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375629184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (13228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.086038:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787833714.086307:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833714.093334:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8578:1874679375629312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833714.093439:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.093480:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375629312 00000100:00100000:0.0:1787833714.093486:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375629312 00000100:00100000:0.0:1787833714.093542:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787833714.093551:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8578:x1874679375629312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833714.093815:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8578:x1874679375629312:12345-0@lo:502:llog_process_th.0 Request processed in 264us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.093823:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787833714.093873:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64468b53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833714.093910:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8578:1874679375629312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833714.093937:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833714.093948:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833714.093951:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787833714.093961:0:8578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b64773a1800 00000020:00000080:0.0:1787833714.093964:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787833714.094034:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8578:1874679375629440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833714.094073:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833714.094096:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64468b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.094101:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375629440 00000100:00100000:3.0:1787833714.094108:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375629440 00000100:00100000:3.0:1787833714.094141:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787833714.094150:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8578:x1874679375629440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833714.095249:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:8578:x1874679375629440:12345-0@lo:502:llog_process_th.0 Request processed in 1095us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.095259:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787833714.097001:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8578:1874679375629440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787833714.097040:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833714.097049:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833714.097057:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787833714.097075:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787833714.098233:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787833714.098261:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787833714.098274:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.098298:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833714.098309:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787833714.098312:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6460630000 from 4 10000000:01000000:2.0:1787833714.098327:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787833714.098418:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.098426:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833714.098436:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833714.098459:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787833714.098538:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833714.098580:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64442806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833714.102653:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375629568 00000100:00100000:0.0:1787833714.102672:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375629568 00000100:00100000:0.0:1787833714.102726:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787833714.102737:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375629568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833714.102756:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833714.102776:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774d85 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.102804:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d85 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.102827:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d85 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833714.102837:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031e00, rc 0) 00000100:00100000:0.0:1787833714.102927:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375629568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833714.102935:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787833714.103635:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833714.103659:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.103670:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833714.103743:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.103787:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.103838:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833714.104129:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375629696 00000100:00100000:1.0:1787833714.104136:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375629696 00000100:00100000:1.0:1787833714.104179:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787833714.104187:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375629696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833714.104678:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375629696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 489us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833714.104687:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787833714.105711:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.105777:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.105846:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.105881:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.105900:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375629824 00000100:00100000:3.0:1787833714.105905:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375629824 00000100:00100000:3.0:1787833714.105950:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787833714.105966:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375629824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.106146:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375629824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.106154:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787833714.106205:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375629824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833714.106446:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8580:1874679375629952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833714.106631:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.106656:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375629952 00000100:00100000:3.0:1787833714.106661:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375629952 00000100:00100000:3.0:1787833714.106684:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787833714.106690:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:8580:x1874679375629952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833714.106845:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:8580:x1874679375629952:12345-0@lo:502:llog_process_th.0 Request processed in 153us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.106853:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787833714.106890:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.106903:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8580:1874679375629952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833714.106925:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833714.106935:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833714.106937:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787833714.106944:0:8580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6460630000 00000020:00000080:3.0:1787833714.106947:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787833714.107020:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8580:1874679375630080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833714.107052:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833714.107069:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375630080 00000100:00100000:3.0:1787833714.107073:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375630080 00000100:00100000:3.0:1787833714.107100:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787833714.107106:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:8580:x1874679375630080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833714.107228:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:8580:x1874679375630080:12345-0@lo:502:llog_process_th.0 Request processed in 122us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833714.107235:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787833714.107267:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787833714.107280:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:8580:1874679375630080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833714.107298:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833714.107302:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833714.107304:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787833714.107308:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787833714.107383:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787833714.107400:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833714.107410:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833714.107421:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833715.004715:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833715.260833:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375630208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833715.260918:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833715.261122:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375630208 00000100:00100000:0.0:1787833715.261130:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375630208 00000100:00100000:0.0:1787833715.261190:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787833715.261201:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375630208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833715.261234:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833715.261275:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375630208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833715.261284:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787833715.261318:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833715.261573:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f9f9a40 x1874679375630208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833715.261593:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375630208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787833716.028591:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833717.053480:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833717.827789:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375630336:0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.827871:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833717.831277:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833717.831303:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375630720:0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.831393:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833717.831456:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375630336 00000100:00100000:0.0:1787833717.831473:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375630336 00000100:00100000:0.0:1787833717.831530:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787833717.831539:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375630336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.831598:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375630336:12345-0@lo:400:kworker.0 Request processed in 60us (3727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833717.831605:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787833717.832099:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375630592:0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.832131:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833717.832157:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833717.832164:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375630464:0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.832187:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833717.832215:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375630720 00000100:00100000:0.0:1787833717.832219:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375630720 00000100:00100000:0.0:1787833717.832259:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787833717.832266:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375630720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.832302:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375630720:12345-0@lo:400:kworker.0 Request processed in 36us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833717.832308:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787833717.832328:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375630592 00000100:00100000:0.0:1787833717.832332:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375630592 00000100:00100000:0.0:1787833717.832391:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375630464 00000100:00100000:0.0:1787833717.832394:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375630464 00000100:00100000:0.0:1787833717.832416:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787833717.832422:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375630592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.832459:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375630592:12345-0@lo:400:kworker.0 Request processed in 37us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833717.832475:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787833717.832487:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787833717.832493:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375630464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.832519:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375630464:12345-0@lo:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833717.832525:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787833717.832543:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833717.832547:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833717.832582:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375630464:0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.832591:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375630592:0@lo:400:kworker.0 00010000:00080000:0.0:1787833717.833578:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734cb40 x1874679375630720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833717.833593:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375630720:0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.833604:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375630336:0@lo:400:kworker.0 00000100:00100000:1.0:1787833717.836185:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375630848:0@lo:400:kworker.0 00000100:00100000:1.0:1787833717.836254:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833717.836741:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375630976:0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.836777:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833717.836817:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375630976 00000100:00100000:0.0:1787833717.836824:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375630976 00000100:00100000:0.0:1787833717.836882:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787833717.836898:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375630976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.836958:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375630976:12345-0@lo:400:kworker.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833717.836965:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787833717.837005:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f9f9a40 x1874679375630976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833717.837019:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375630976:0@lo:400:kworker.0 00000100:00080000:0.0:1787833717.837038:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833717.837051:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375630848 00000100:00100000:0.0:1787833717.837054:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375630848 00000100:00100000:0.0:1787833717.837082:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787833717.837089:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375630848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833717.838894:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375630848:12345-0@lo:400:kworker.0 Request processed in 1796us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833717.838909:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787833717.838959:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833717.839353:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375630848:0@lo:400:kworker.0 00010000:00010000:0.0:1787833718.076810:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833718.332524:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833718.332549:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375631104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833718.332633:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833718.332705:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375631104 00000100:00100000:0.0:1787833718.332712:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375631104 00000100:00100000:0.0:1787833718.332773:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787833718.332782:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375631104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833718.332819:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833718.332864:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375631104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833718.332880:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787833718.332925:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f9f9a40 x1874679375631104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833718.332944:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375631104:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787833718.829724:0:8786:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1787833718.980253:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833718.980841:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833718.980879:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833718.980911:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833718.980937:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367212160 00000100:00100000:0.0:1787833718.980946:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367212160 00000100:00100000:0.0:1787833718.980999:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367212288 00000100:00100000:0.0:1787833718.981002:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367212288 00000100:00100000:0.0:1787833718.981025:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787833718.981035:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2344:x1874679367212160:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833718.981113:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2344:x1874679367212160:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833718.981120:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787833718.981137:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787833718.981144:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6449185e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367212288:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833718.981168:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6449185e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367212288:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833718.981174:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00080000:0.0:1787833718.981193:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833718.981196:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833718.983684:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367212032 00000100:00100000:3.0:1787833718.983714:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367212032 00000100:00100000:2.0:1787833718.983827:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367211904 00000100:00100000:2.0:1787833718.983832:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367211904 00000100:00100000:2.0:1787833718.983876:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 194 00000100:00100000:2.0:1787833718.983886:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367211904:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833718.983957:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367211904:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 72us (3713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833718.983964:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 194 00000100:00080000:2.0:1787833718.988909:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833718.993871:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:3.0:1787833718.993890:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367212032:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833718.994087:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367212032:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 204us (13247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833718.994096:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00010000:00010000:2.0:1787833719.100620:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833720.124688:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833720.380873:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833720.380897:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375631232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833720.380967:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833720.381190:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375631232 00000100:00100000:0.0:1787833720.381204:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375631232 00000100:00100000:0.0:1787833720.381267:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787833720.381275:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375631232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833720.381310:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833720.381379:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375631232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833720.381387:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787833720.381426:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93e1c0 x1874679375631232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833720.381455:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375631232:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787833720.383558:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787833721.148609:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833722.174631:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833722.940889:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375631488:0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.940970:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833722.941030:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375632000:0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.941058:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833722.941093:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833722.941099:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375631616:0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.941150:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833722.941187:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375631488 00000100:00100000:1.0:1787833722.941195:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375631488 00000100:00100000:1.0:1787833722.941244:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375631616 00000100:00100000:1.0:1787833722.941247:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375631616 00000100:00100000:1.0:1787833722.941275:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787833722.941283:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375631488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.941356:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375631488:12345-0@lo:400:kworker.0 Request processed in 55us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833722.941365:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787833722.941382:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787833722.941389:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375631616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.941417:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375631616:12345-0@lo:400:kworker.0 Request processed in 29us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833722.941434:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787833722.941453:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375632000 00000100:00100000:1.0:1787833722.941456:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375632000 00000100:00100000:1.0:1787833722.941485:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787833722.941492:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375632000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.941539:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375632000:12345-0@lo:400:kworker.0 Request processed in 47us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833722.941546:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787833722.941572:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833722.941575:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833722.941609:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375631616:0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.941619:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375631488:0@lo:400:kworker.0 00010000:00080000:1.0:1787833722.941643:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734ed00 x1874679375632000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833722.941653:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375632000:0@lo:400:kworker.0 00000100:00100000:0.0:1787833722.941957:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375631360:0@lo:400:kworker.0 00000100:00100000:0.0:1787833722.942000:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833722.942038:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375631872:0@lo:400:kworker.0 00000100:00100000:0.0:1787833722.942063:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833722.942080:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833722.942086:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375631744:0@lo:400:kworker.0 00000100:00100000:0.0:1787833722.942107:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833722.942148:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375631744 00000100:00100000:0.0:1787833722.942152:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375631744 00000100:00100000:0.0:1787833722.942186:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787833722.942193:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375631744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833722.942230:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375631744:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833722.942237:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787833722.942268:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734f840 x1874679375631744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833722.942288:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375631744:0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.942409:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375631360 00000100:00100000:1.0:1787833722.942414:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375631360 00000100:00100000:1.0:1787833722.942460:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787833722.942467:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375631360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.942607:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375631360:12345-0@lo:400:kworker.0 Request processed in 140us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833722.942614:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1787833722.942640:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833722.942650:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375631872 00000100:00100000:1.0:1787833722.942653:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375631872 00000100:00100000:1.0:1787833722.942683:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787833722.942690:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375631872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833722.942721:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375631872:12345-0@lo:400:kworker.0 Request processed in 32us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833722.942728:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787833722.942744:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833722.942807:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375631360:0@lo:400:kworker.0 00000100:00100000:0.0:1787833722.942818:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375631872:0@lo:400:kworker.0 00010000:00010000:3.0:1787833723.199042:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833723.454701:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833723.454774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833723.455019:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375632128 00000100:00100000:1.0:1787833723.455027:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375632128 00000100:00100000:1.0:1787833723.455083:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787833723.455092:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375632128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833723.455129:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833723.455183:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375632128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833723.455211:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787833723.455253:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734ed00 x1874679375632128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833723.455270:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833724.089527:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833724.089568:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833724.089597:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833724.089632:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833724.089669:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367212672 00000100:00100000:3.0:1787833724.089678:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367212672 00000100:00100000:3.0:1787833724.089732:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367212800 00000100:00100000:3.0:1787833724.089735:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367212800 00000100:00100000:3.0:1787833724.089760:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787833724.089770:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452888f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2343:x1874679367212672:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:3.0:1787833724.089806:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774cc8 00000100:00080000:3.0:1787833724.089816:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b634182d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787833724.089853:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787833724.090046:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787833724.090057:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2343:x1874679367212800:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:0.0:1787833724.090077:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774ccf 00000100:00080000:0.0:1787833724.090083:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9b634182b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787833724.090111:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787833724.090465:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+2:2343:x1874679367212800:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 409us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833724.090474:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00010000:00010000:0.0:1787833724.090501:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833724.090528:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833724.091267:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367212416 00000100:00100000:2.0:1787833724.091276:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367212416 00000100:00100000:2.0:1787833724.091314:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 196 00000100:00100000:2.0:1787833724.091322:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2346:x1874679367212416:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833724.091459:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452888f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+2:2343:x1874679367212672:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 1690us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833724.091469:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787833724.091494:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367212544 00000100:00100000:3.0:1787833724.091497:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367212544 00000100:00100000:3.0:1787833724.091529:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:3.0:1787833724.091536:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367212544:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833724.091564:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367212544:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833724.091570:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00080000:3.0:1787833724.091587:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833724.091591:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833724.091593:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833724.091762:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2346:x1874679367212416:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 440us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833724.091770:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 196 00010000:00010000:1.0:1787833724.221843:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787833724.300586:0:9029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing yml_node 00010000:00010000:1.0:1787833725.246144:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833725.500572:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375632256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833725.500654:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833725.500829:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375632256 00000100:00100000:0.0:1787833725.500839:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375632256 00000100:00100000:0.0:1787833725.500910:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787833725.501001:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833725.501024:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375632256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833725.501062:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833725.503035:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375632256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2110us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833725.503050:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787833725.503263:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93ed00 x1874679375632256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833725.503286:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375632256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787833726.270924:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833727.294375:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787833727.603847:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:2.0:1787833727.603857:0:6686:0:(genops.c:885:class_export_put()) final put ffff9b634182e800/320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:3.0:1787833727.604303:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b634182e800/320cb14b-678a-483a-8914-ee446104f369 for lustre-OST0000 00000020:00000080:3.0:1787833727.604402:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b634182d000 for lustre-OST0000 00000100:00100000:3.0:1787833728.062335:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6452889680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375632384:0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.062448:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833728.062494:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375632896:0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.062519:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833728.062542:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833728.062548:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375632768:0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.062570:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833728.062592:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64528883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375632640:0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.062614:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833728.062632:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787833728.062638:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375632512:0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.062671:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833728.062688:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375633024:0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.062708:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833728.062737:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375632384 00000100:00100000:3.0:1787833728.062744:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375632384 00000100:00100000:3.0:1787833728.062788:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787833728.062797:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375632384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.062843:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375632384:12345-0@lo:400:kworker.0 Request processed in 47us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833728.062849:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787833728.062879:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375632896 00000100:00100000:3.0:1787833728.062883:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375632896 00000100:00100000:3.0:1787833728.062916:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375632640 00000100:00100000:3.0:1787833728.062919:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375632640 00000100:00100000:3.0:1787833728.062932:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375632512 00000100:00100000:3.0:1787833728.062934:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375632512 00000100:00100000:3.0:1787833728.062945:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787833728.062951:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375632896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.062984:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375632896:12345-0@lo:400:kworker.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833728.062989:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787833728.063000:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787833728.063005:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375632640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.063032:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375632640:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833728.063037:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787833728.063047:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787833728.063058:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375632512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.063085:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375632512:12345-0@lo:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833728.063090:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787833728.063136:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375632512:0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.063147:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64528883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375632640:0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.063176:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6452889680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375632384:0@lo:400:kworker.0 00000100:00100000:3.0:1787833728.063185:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375632896:0@lo:400:kworker.0 00000100:00100000:1.0:1787833728.064553:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375632768 00000100:00100000:1.0:1787833728.064573:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375632768 00000100:00100000:1.0:1787833728.064631:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375633024 00000100:00100000:1.0:1787833728.064634:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375633024 00000100:00100000:1.0:1787833728.064653:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787833728.064661:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375632768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833728.065235:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375632768:12345-0@lo:400:kworker.0 Request processed in 573us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833728.065243:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787833728.065261:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833728.065268:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462315a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375633024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833728.065293:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462315a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375633024:12345-0@lo:400:kworker.0 Request processed in 27us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833728.065298:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787833728.065792:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833728.065797:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833728.065801:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787833728.067696:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b645288bc00 x1874679375633024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833728.067715:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375633024:0@lo:400:kworker.0 00010000:00080000:3.0:1787833728.067762:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b645288a940 x1874679375632768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833728.067772:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375632768:0@lo:400:kworker.0 00010000:00010000:1.0:1787833728.322797:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787833728.427752:0:9222:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.98 00000100:00100000:1.0:1787833728.574102:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375633152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833728.574174:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833728.583965:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375633152 00000100:00100000:0.0:1787833728.583980:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375633152 00000100:00100000:0.0:1787833728.584045:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787833728.584056:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375633152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833728.584103:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833728.584194:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375633152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (10020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833728.584201:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787833728.584260:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734de00 x1874679375633152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833728.584280:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375633152:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787833728.642751:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:2.0:1787833728.642764:0:7626:0:(genops.c:885:class_export_put()) final put ffff9b634182c000/320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:2.0:1787833728.642920:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b634182c000/320cb14b-678a-483a-8914-ee446104f369 for lustre-OST0001 00000020:00000080:2.0:1787833728.642963:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b634182b800 for lustre-OST0001 00000100:00100000:3.0:1787833729.205236:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833729.205283:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833729.205400:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367213056 00000100:00100000:1.0:1787833729.205410:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367213056 00000100:00100000:1.0:1787833729.205500:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787833729.205508:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367213056:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833729.205575:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367213056:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833729.205582:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00080000:3.0:1787833729.205802:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833729.205849:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367212928 00000100:00100000:2.0:1787833729.205853:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367212928 00000100:00100000:2.0:1787833729.205884:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 198 00000100:00100000:2.0:1787833729.205896:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367212928:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833729.205930:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367212928:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833729.205936:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 198 00010000:00010000:0.0:1787833729.342457:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833730.368449:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833730.622273:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833730.622298:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375633280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833730.622427:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833730.622764:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375633280 00000100:00100000:0.0:1787833730.622774:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375633280 00000100:00100000:0.0:1787833730.622845:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787833730.622855:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375633280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787833730.622897:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833730.622947:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375633280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833730.622955:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787833730.623066:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833730.623097:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93f480 x1874679375633280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833730.623134:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375633280:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787833731.099511:0:9321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.98 00010000:00010000:2.0:1787833731.388541:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833732.413651:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833733.181707:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375633536:0@lo:400:kworker.0 00000100:00100000:0.0:1787833733.181799:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833733.181856:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375634048:0@lo:400:kworker.0 00000100:00100000:0.0:1787833733.181904:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833733.181937:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833733.181958:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375633664:0@lo:400:kworker.0 00000100:00100000:0.0:1787833733.181984:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833733.182026:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375633536 00000100:00100000:0.0:1787833733.182032:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375633536 00000100:00100000:0.0:1787833733.182079:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375633664 00000100:00100000:0.0:1787833733.182082:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375633664 00000100:00100000:0.0:1787833733.182127:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833733.182136:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375633536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833733.182194:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375633536:12345-0@lo:400:kworker.0 Request processed in 59us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833733.182203:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833733.182221:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787833733.182227:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375633664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833733.182255:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375633664:12345-0@lo:400:kworker.0 Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833733.182261:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787833733.182280:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375634048 00000100:00100000:0.0:1787833733.182283:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375634048 00000100:00100000:0.0:1787833733.182325:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787833733.182364:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375634048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833733.182408:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375634048:12345-0@lo:400:kworker.0 Request processed in 46us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833733.182415:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787833733.182441:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833733.182445:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833733.182479:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375633664:0@lo:400:kworker.0 00000100:00100000:0.0:1787833733.182490:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375633536:0@lo:400:kworker.0 00010000:00080000:0.0:1787833733.182511:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93c3c0 x1874679375634048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833733.182522:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375634048:0@lo:400:kworker.0 00000100:00100000:3.0:1787833733.182619:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375633408:0@lo:400:kworker.0 00000100:00100000:3.0:1787833733.182652:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833733.182673:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375633920:0@lo:400:kworker.0 00000100:00100000:3.0:1787833733.182688:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833733.182700:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833733.182703:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375633792:0@lo:400:kworker.0 00000100:00100000:3.0:1787833733.182715:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833733.182731:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375633408 00000100:00100000:3.0:1787833733.182734:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375633408 00000100:00100000:3.0:1787833733.182754:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787833733.182758:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375633408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833733.182779:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375633408:12345-0@lo:400:kworker.0 Request processed in 22us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833733.182783:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787833733.182803:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375633792 00000100:00100000:3.0:1787833733.182806:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375633792 00000100:00100000:3.0:1787833733.182823:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833733.182827:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375633792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833733.182845:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375633792:12345-0@lo:400:kworker.0 Request processed in 19us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833733.182849:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787833733.182861:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833733.182870:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93e580 x1874679375633792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833733.182886:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375633792:0@lo:400:kworker.0 00000100:00100000:3.0:1787833733.182892:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375633408:0@lo:400:kworker.0 00000100:00100000:3.0:1787833733.182906:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375633920 00000100:00100000:3.0:1787833733.182907:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375633920 00000100:00100000:3.0:1787833733.182924:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787833733.182928:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375633920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833733.182950:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375633920:12345-0@lo:400:kworker.0 Request processed in 22us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833733.182953:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787833733.182963:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833733.182973:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375633920:0@lo:400:kworker.0 00010000:00010000:3.0:1787833733.438316:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833733.694381:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375634176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833733.694456:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833733.694549:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375634176 00000100:00100000:1.0:1787833733.694557:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375634176 00000100:00100000:1.0:1787833733.694604:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833733.694613:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375634176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833733.694648:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833733.694691:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375634176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833733.694698:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787833733.695058:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734c3c0 x1874679375634176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833733.695076:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375634176:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787833733.717875:0:9420:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.98 00000100:00100000:3.0:1787833734.323999:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833734.324048:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833734.324152:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367213312 00000100:00100000:0.0:1787833734.324162:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367213312 00000100:00100000:0.0:1787833734.324244:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787833734.324256:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452889680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367213312:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833734.324385:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452889680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367213312:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 132us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833734.324393:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787833734.324720:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367213184 00000100:00100000:1.0:1787833734.324726:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367213184 00000100:00100000:1.0:1787833734.324765:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 200 00000100:00100000:1.0:1787833734.324773:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367213184:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833734.324814:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367213184:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 43us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833734.324837:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 200 00000100:00080000:3.0:1787833734.325149:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787833734.462406:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787833735.258492:0:9468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 08:28:54 EDT 2026 00010000:00010000:0.0:1787833735.486991:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833735.741695:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833735.741719:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375634304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833735.741785:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833735.742370:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375634304 00000100:00100000:1.0:1787833735.742380:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375634304 00000100:00100000:1.0:1787833735.742466:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787833735.742477:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375634304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833735.742515:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833735.742574:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375634304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833735.742582:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787833735.742625:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93c780 x1874679375634304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833735.742644:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375634304:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787833735.742879:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787833736.509746:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833737.532543:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833738.308632:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375634816:0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.308703:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.308757:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787833738.308763:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375634432:0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.308793:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.308816:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375634944:0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.308839:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.308865:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f939e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375634560:0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.308889:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.308908:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375635072:0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.308929:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.308946:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833738.308951:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375634688:0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.308970:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.308998:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375634816 00000100:00100000:2.0:1787833738.309004:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375634816 00000100:00100000:2.0:1787833738.309054:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375635072 00000100:00100000:2.0:1787833738.309058:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375635072 00000100:00100000:2.0:1787833738.309079:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787833738.309100:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375634816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.309151:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375634816:12345-0@lo:400:kworker.0 Request processed in 53us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.309158:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787833738.309174:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787833738.309180:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375635072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.309211:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375635072:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.309216:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787833738.309575:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375634432 00000100:00100000:2.0:1787833738.309580:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375634432 00000100:00100000:2.0:1787833738.309607:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787833738.309614:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375634432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.309646:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375634432:12345-0@lo:400:kworker.0 Request processed in 33us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.309653:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787833738.309679:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375634944 00000100:00100000:2.0:1787833738.309683:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375634944 00000100:00100000:2.0:1787833738.309706:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375634560 00000100:00100000:2.0:1787833738.309709:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375634560 00000100:00100000:2.0:1787833738.309718:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375634688 00000100:00100000:2.0:1787833738.309721:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375634688 00000100:00100000:2.0:1787833738.309732:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787833738.309739:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375634944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.309767:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375634944:12345-0@lo:400:kworker.0 Request processed in 29us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.309773:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787833738.309792:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787833738.309798:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375634560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.309826:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375634560:12345-0@lo:400:kworker.0 Request processed in 29us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.309832:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787833738.309842:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787833738.309847:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375634688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.309870:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375634688:12345-0@lo:400:kworker.0 Request processed in 23us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.309875:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787833738.309898:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787833738.309903:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833738.309905:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833738.309937:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375634432:0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.309950:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375634944:0@lo:400:kworker.0 00010000:00080000:2.0:1787833738.309963:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f9392c0 x1874679375634816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833738.309974:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375634816:0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.310006:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375634688:0@lo:400:kworker.0 00000100:00100000:2.0:1787833738.310015:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f939e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375634560:0@lo:400:kworker.0 00010000:00080000:2.0:1787833738.310024:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93a1c0 x1874679375635072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833738.310032:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375635072:0@lo:400:kworker.0 00010000:00010000:0.0:1787833738.557443:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833738.812685:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375635200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833738.812782:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833738.812870:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375635200 00000100:00100000:2.0:1787833738.812878:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375635200 00000100:00100000:2.0:1787833738.812939:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787833738.812949:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375635200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833738.813007:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833738.813050:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375635200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833738.813057:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787833738.813111:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734de00 x1874679375635200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833738.813131:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375635200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833739.440131:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833739.440183:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833739.440866:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367213568 00000100:00100000:0.0:1787833739.440876:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367213568 00000100:00100000:0.0:1787833739.440966:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:0.0:1787833739.440976:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2347:x1874679367213568:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833739.441058:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2347:x1874679367213568:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 82us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833739.441065:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:2.0:1787833739.441480:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367213440 00000100:00100000:2.0:1787833739.441486:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367213440 00000100:00100000:2.0:1787833739.441543:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 202 00000100:00100000:2.0:1787833739.441550:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2347:x1874679367213440:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833739.441584:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2347:x1874679367213440:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833739.441590:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 202 00000100:00080000:3.0:1787833739.441739:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787833739.580608:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833740.608935:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833740.860610:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833740.860944:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375635328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833740.861309:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833740.862070:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375635328 00000100:00100000:1.0:1787833740.862080:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375635328 00000100:00100000:2.0:1787833740.863305:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787833740.863318:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375635328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833740.863382:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833740.863457:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375635328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833740.863480:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787833740.863528:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93fc00 x1874679375635328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833740.863547:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375635328:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787833740.863806:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787833741.633405:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833742.655461:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833743.421896:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375635712:0@lo:400:kworker.0 00000100:00100000:3.0:1787833743.421989:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833743.422049:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787833743.422055:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375635584:0@lo:400:kworker.0 00000100:00100000:3.0:1787833743.422074:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833743.422089:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375636096:0@lo:400:kworker.0 00000100:00100000:3.0:1787833743.422109:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833743.422140:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375635712 00000100:00100000:3.0:1787833743.422146:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375635712 00000100:00100000:3.0:1787833743.422194:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375635584 00000100:00100000:3.0:1787833743.422196:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375635584 00000100:00100000:3.0:1787833743.422218:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787833743.422227:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375635712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833743.422288:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375635712:12345-0@lo:400:kworker.0 Request processed in 62us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833743.422296:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787833743.422312:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787833743.422317:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375635584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833743.422338:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375635584:12345-0@lo:400:kworker.0 Request processed in 22us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833743.422365:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787833743.422400:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375636096 00000100:00100000:3.0:1787833743.422403:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375636096 00000100:00100000:3.0:1787833743.422428:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787833743.422433:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375636096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833743.422471:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375636096:12345-0@lo:400:kworker.0 Request processed in 38us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833743.422477:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787833743.422491:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833743.422495:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833743.422594:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375635584:0@lo:400:kworker.0 00010000:00080000:3.0:1787833743.422606:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa152c0 x1874679375636096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833743.422616:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375636096:0@lo:400:kworker.0 00000100:00100000:3.0:1787833743.422623:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375635712:0@lo:400:kworker.0 00000100:00100000:1.0:1787833743.422912:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375635840:0@lo:400:kworker.0 00000100:00100000:1.0:1787833743.422947:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833743.422985:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787833743.422992:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375635456:0@lo:400:kworker.0 00000100:00100000:1.0:1787833743.423019:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833743.423050:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375635968:0@lo:400:kworker.0 00000100:00100000:1.0:1787833743.423090:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833743.423159:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375635456 00000100:00100000:0.0:1787833743.423164:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375635456 00000100:00100000:0.0:1787833743.423205:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787833743.423212:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375635456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833743.423265:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375635456:12345-0@lo:400:kworker.0 Request processed in 54us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833743.423281:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787833743.423319:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375635456:0@lo:400:kworker.0 00000100:00100000:3.0:1787833743.423518:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375635840 00000100:00100000:3.0:1787833743.423521:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375635840 00000100:00100000:3.0:1787833743.423554:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833743.423559:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375635840:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787833743.423627:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833743.423728:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375635840:12345-0@lo:400:kworker.0 Request processed in 169us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833743.423733:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833743.423747:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375635968 00000100:00100000:3.0:1787833743.423749:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375635968 00000100:00100000:3.0:1787833743.423781:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787833743.423788:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375635968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833743.423817:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375635968:12345-0@lo:400:kworker.0 Request processed in 30us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833743.423823:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787833743.423899:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787833743.424810:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa17840 x1874679375635840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833743.424826:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375635840:0@lo:400:kworker.0 00000100:00100000:1.0:1787833743.426758:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375635968:0@lo:400:kworker.0 00010000:00010000:3.0:1787833743.676513:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833743.937442:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833743.937473:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375636224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833743.937556:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833743.937643:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375636224 00000100:00100000:1.0:1787833743.937651:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375636224 00000100:00100000:1.0:1787833743.937702:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787833743.937712:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375636224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833743.937754:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833743.937810:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375636224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833743.937818:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787833743.937862:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734de00 x1874679375636224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833743.937882:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375636224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833744.559791:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833744.560765:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367213696 00000100:00100000:3.0:1787833744.560779:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367213696 00000100:00100000:3.0:1787833744.560840:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 204 00000100:00100000:3.0:1787833744.560850:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2347:x1874679367213696:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833744.560934:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2347:x1874679367213696:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 85us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833744.560941:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 204 00000100:00100000:0.0:1787833744.562764:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833744.563607:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367213824 00000100:00100000:2.0:1787833744.563616:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367213824 00000100:00100000:2.0:1787833744.563676:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:2.0:1787833744.563684:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+6:2347:x1874679367213824:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833744.563751:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+6:2347:x1874679367213824:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 68us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833744.563758:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00080000:1.0:1787833744.563890:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787833744.703377:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833745.726119:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833745.981574:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833745.981597:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375636352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833745.981678:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833745.981750:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375636352 00000100:00100000:3.0:1787833745.981758:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375636352 00000100:00100000:3.0:1787833745.981821:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787833745.981829:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375636352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833745.981864:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833745.981909:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375636352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833745.981918:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787833745.981940:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833745.981983:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa14780 x1874679375636352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833745.982003:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375636352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787833746.748723:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833747.772881:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833748.540766:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375636480:0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.540840:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833748.540900:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375636992:0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.540940:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833748.540967:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833748.540973:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375636864:0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.540995:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833748.541017:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375636736:0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.541034:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833748.541049:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787833748.541053:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375636608:0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.541069:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833748.541082:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375637120:0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.541099:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833748.541125:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375636992 00000100:00100000:3.0:1787833748.541132:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375636992 00000100:00100000:3.0:1787833748.541201:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375636736 00000100:00100000:3.0:1787833748.541204:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375636736 00000100:00100000:3.0:1787833748.541219:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375636608 00000100:00100000:3.0:1787833748.541221:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375636608 00000100:00100000:3.0:1787833748.541245:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787833748.541255:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375636992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833748.541268:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375636864 00000100:00100000:1.0:1787833748.541272:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375636864 00000100:00100000:3.0:1787833748.541305:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375636992:12345-0@lo:400:kworker.0 Request processed in 52us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833748.541309:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375637120 00000100:00100000:1.0:1787833748.541311:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375637120 00000100:00100000:3.0:1787833748.541312:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787833748.541329:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787833748.541329:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833748.541335:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375636736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833748.541369:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375636864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.541387:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375636736:12345-0@lo:400:kworker.0 Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833748.541394:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787833748.541397:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375636864:12345-0@lo:400:kworker.0 Request processed in 57us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833748.541403:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833748.541412:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787833748.541414:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787833748.541418:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375636608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833748.541418:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375637120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.541445:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375636608:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833748.541451:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787833748.541452:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375637120:12345-0@lo:400:kworker.0 Request processed in 34us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833748.541458:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787833748.541467:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833748.541471:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833748.541473:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833748.541602:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375636480 00000100:00100000:0.0:1787833748.541606:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375636480 00000100:00100000:3.0:1787833748.547446:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375636608:0@lo:400:kworker.0 00010000:00080000:3.0:1787833748.547470:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93c000 x1874679375637120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833748.547492:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375637120:0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.547509:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375636736:0@lo:400:kworker.0 00010000:00080000:3.0:1787833748.547562:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93e580 x1874679375636864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833748.547572:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375636864:0@lo:400:kworker.0 00000100:00100000:3.0:1787833748.547585:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375636992:0@lo:400:kworker.0 00000100:00100000:0.0:1787833748.563654:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787833748.563683:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375636480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833748.563785:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375636480:12345-0@lo:400:kworker.0 Request processed in 117us (22945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833748.563792:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787833748.563860:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375636480:0@lo:400:kworker.0 00010000:00010000:1.0:1787833748.796589:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833749.053434:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833749.053460:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375637248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833749.053534:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833749.055197:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375637248 00000100:00100000:3.0:1787833749.055210:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375637248 00000100:00100000:3.0:1787833749.055282:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833749.055293:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375637248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833749.055332:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833749.055447:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375637248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833749.055471:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787833749.055531:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647734ed00 x1874679375637248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833749.055551:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375637248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833749.687548:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833749.687636:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367214080 00000100:00100000:2.0:1787833749.687646:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367214080 00000100:00100000:1.0:1787833749.687665:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833749.687686:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367213952 00000100:00100000:1.0:1787833749.687690:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367213952 00000100:00100000:2.0:1787833749.687709:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:2.0:1787833749.687720:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367214080:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833749.687727:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:1.0:1787833749.687734:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2347:x1874679367213952:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833749.687804:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2347:x1874679367213952:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 70us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833749.687819:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:2.0:1787833749.691229:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367214080:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 3495us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833749.691247:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00080000:0.0:1787833749.693529:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787833749.821362:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787833750.028878:0:10098:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:29:08 (1787833748) === 00000100:00100000:3.0:1787833750.528071:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833750.528157:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367214208 00000100:00100000:0.0:1787833750.528168:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367214208 00000100:00100000:0.0:1787833750.528231:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:0.0:1787833750.528240:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:8118:x1874679367214208:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787833750.528286:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833750.528303:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6440030200/0x2bdb54ee5e774d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe39d2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833750.528332:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6440030200/0x2bdb54ee5e774d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39d2 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833750.528363:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6440030200/0x2bdb54ee5e774d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39d2 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833750.528373:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440030200, rc 0) 00000100:00100000:0.0:1787833750.528430:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8118:x1874679367214208:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 191us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833750.528438:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:1.0:1787833750.537912:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833750.539938:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367214336 00000100:00100000:0.0:1787833750.539955:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367214336 00000100:00100000:0.0:1787833750.540039:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 208 00000100:00100000:0.0:1787833750.540049:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8118:x1874679367214336:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787833750.541077:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8118:x1874679367214336:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 1021us (3172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833750.541090:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 208 00000100:00100000:2.0:1787833750.553909:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833750.554048:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367214464 00000100:00100000:1.0:1787833750.554084:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367214464 00000100:00100000:1.0:1787833750.554418:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:1.0:1787833750.554433:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8118:x1874679367214464:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787833750.554933:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8118:x1874679367214464:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 503us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833750.554943:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:3.0:1787833750.559301:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833750.560768:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367214592 00000100:00100000:0.0:1787833750.560788:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367214592 00000100:00100000:0.0:1787833750.560870:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:0.0:1787833750.560883:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8122:x1874679367214592:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787833750.561310:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8122:x1874679367214592:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 427us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833750.561327:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:0.0:1787833750.592683:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833750.592835:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367214720 00000100:00100000:1.0:1787833750.592849:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367214720 00000100:00100000:1.0:1787833750.592920:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:1.0:1787833750.592933:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8122:x1874679367214720:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787833750.593384:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8122:x1874679367214720:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 453us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833750.593394:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:2.0:1787833750.605765:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833750.605875:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367214848 00000100:00100000:3.0:1787833750.605889:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367214848 00000100:00100000:3.0:1787833750.605973:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:3.0:1787833750.605986:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+11:8118:x1874679367214848:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787833750.606010:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833750.606035:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2d200/0x2bdb54ee5e774d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe39fc expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833750.606073:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2d200/0x2bdb54ee5e774d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39fc expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833750.606087:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2d200/0x2bdb54ee5e774d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39fc expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833750.606099:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2d200, rc 0) 00000100:00100000:3.0:1787833750.606202:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+12:8118:x1874679367214848:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 218us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833750.606211:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:2.0:1787833750.609868:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833750.609996:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367214976 00000100:00100000:0.0:1787833750.610010:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367214976 00000100:00100000:0.0:1787833750.610090:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:0.0:1787833750.610102:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:8118:x1874679367214976:12345-192.168.202.15@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787833750.610149:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787833750.610191:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787833750.610195:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787833750.610199:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787833750.610201:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787833750.613743:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:8118:x1874679367214976:12345-192.168.202.15@tcp:256:mount.lustre.0 Request processed in 3625us (3872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833750.613764:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:2.0:1787833750.623291:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833750.623512:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367215104 00000100:00100000:1.0:1787833750.623527:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367215104 00000100:00100000:1.0:1787833750.623622:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:1.0:1787833750.623634:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:8118:x1874679367215104:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787833750.623660:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833750.623687:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a03 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833750.623732:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a03 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833750.623774:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a03 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833750.623786:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199800, rc 0) 00000100:00100000:1.0:1787833750.623885:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:8118:x1874679367215104:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 249us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833750.623893:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:3.0:1787833750.637116:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833750.637503:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367215232 00000100:00100000:1.0:1787833750.637527:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367215232 00000100:00100000:1.0:1787833750.637699:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:1.0:1787833750.637713:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:8118:x1874679367215232:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787833750.638110:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:8118:x1874679367215232:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 398us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833750.638121:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:0.0:1787833750.650574:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833750.650888:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367215360 00000100:00100000:3.0:1787833750.650902:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367215360 00000100:00100000:3.0:1787833750.650970:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:3.0:1787833750.650982:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:8118:x1874679367215360:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787833750.651310:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:8118:x1874679367215360:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 329us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833750.651327:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:2.0:1787833750.655634:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833750.655786:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367215488 00000100:00100000:1.0:1787833750.655801:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367215488 00000100:00100000:1.0:1787833750.655871:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:1.0:1787833750.655883:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:8126:x1874679367215488:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787833750.656265:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:8126:x1874679367215488:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 383us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833750.656275:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:2.0:1787833750.661639:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833750.661716:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367215616 00000100:00100000:0.0:1787833750.661747:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367215616 00000100:00100000:0.0:1787833750.661819:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:0.0:1787833750.661831:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:8126:x1874679367215616:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787833750.662185:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:8126:x1874679367215616:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 354us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833750.662195:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:0.0:1787833750.666836:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833750.672760:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367215744 00000100:00100000:2.0:1787833750.672810:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367215744 00000100:00100000:2.0:1787833750.672903:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787833750.672915:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2343:x1874679367215744:12345-192.168.202.15@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787833750.672962:0:5816:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from f29a9da7-4b51-4740-bbc6-5079429f87b0@192.168.202.15@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1787833750.673021:0:5816:0:(genops.c:1385:class_connect()) connect: client f29a9da7-4b51-4740-bbc6-5079429f87b0, cookie 0x2bdb54ee5e774da8 00000004:00100000:2.0:1787833750.673066:0:5816:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1787833750.673758:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9b634133b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833750.673854:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:2343:x1874679367215744:12345-192.168.202.15@tcp:38:mount.lustre.0 Request processed in 939us (7032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833750.673866:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787833750.678789:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833750.681323:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367216128 00000100:00100000:0.0:1787833750.681362:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367216128 00000100:00100000:0.0:1787833750.681440:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:0.0:1787833750.681452:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367216128:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833750.681549:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367216128:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 99us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833750.681581:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:3.0:1787833750.682658:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833750.682706:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833750.682738:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367216000 00000100:00100000:2.0:1787833750.682748:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367216000 00000100:00100000:2.0:1787833750.682818:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367215872 00000100:00100000:2.0:1787833750.682823:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367215872 00000100:00100000:2.0:1787833750.682847:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787833750.682855:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+7:8118:x1874679367216000:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787833750.682894:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787833750.682924:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833750.682990:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:2.0:1787833750.682992:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+7:8118:x1874679367216000:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 131us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833750.683004:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787833750.683011:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+7:0:x1874679367215872:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787833750.683049:0:5817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787833750.683125:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:0:x1874679367215872:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 122us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833750.683146:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787833750.687746:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833750.688563:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367216256 00000100:00100000:2.0:1787833750.688642:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367216256 00000100:00100000:2.0:1787833750.688757:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787833750.688770:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:8118:x1874679367216256:12345-192.168.202.15@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787833750.688873:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:8118:x1874679367216256:12345-192.168.202.15@tcp:40:mount.lustre.0 Request processed in 106us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833750.688894:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787833750.696658:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833750.696730:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833750.696763:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833750.698640:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367216384 00000100:00100000:3.0:1787833750.698654:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367216384 00000100:00100000:3.0:1787833750.698712:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367216512 00000100:00100000:3.0:1787833750.698716:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367216512 00000100:00100000:3.0:1787833750.698744:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787833750.698752:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2343:x1874679367216384:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787833750.698786:0:6661:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from f29a9da7-4b51-4740-bbc6-5079429f87b0@192.168.202.15@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1787833750.698820:0:6661:0:(genops.c:1385:class_connect()) connect: client f29a9da7-4b51-4740-bbc6-5079429f87b0, cookie 0x2bdb54ee5e774daf 00002000:00100000:3.0:1787833750.698832:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f29a9da7-4b51-4740-bbc6-5079429f87b0/ffff9b646e1ca000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787833750.698858:0:6661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:2.0:1787833750.699168:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787833750.699185:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1874679367216512:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787833750.699204:0:6659:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from f29a9da7-4b51-4740-bbc6-5079429f87b0@192.168.202.15@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1787833750.699225:0:6659:0:(genops.c:1385:class_connect()) connect: client f29a9da7-4b51-4740-bbc6-5079429f87b0, cookie 0x2bdb54ee5e774db6 00002000:00100000:2.0:1787833750.699231:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f29a9da7-4b51-4740-bbc6-5079429f87b0/ffff9b634133b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787833750.699246:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1787833750.699472:0:6659:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787833750.699505:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b634133f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833750.699592:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:2343:x1874679367216512:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 405us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833750.699601:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00002000:00080000:3.0:1787833750.699939:0:6661:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787833750.699957:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9b646e1c8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833750.699986:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:2343:x1874679367216384:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 1234us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833750.699993:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:0.0:1787833750.702332:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367216640 00000100:00100000:0.0:1787833750.702646:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367216640 00000100:00100000:0.0:1787833750.702760:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:0.0:1787833750.702771:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:8118:x1874679367216640:12345-192.168.202.15@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787833750.703022:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787833750.703183:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:8118:x1874679367216640:12345-192.168.202.15@tcp:33:mount.lustre.0 Request processed in 403us (6525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833750.703191:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00010000:00010000:1.0:1787833750.844559:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833751.100872:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375637376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833751.100953:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833751.101153:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375637376 00000100:00100000:3.0:1787833751.101161:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375637376 00000100:00100000:3.0:1787833751.101240:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833751.101252:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375637376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833751.101277:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833751.101329:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375637376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833751.101335:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787833751.101395:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa152c0 x1874679375637376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833751.101414:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375637376:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787833751.101591:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787833751.870544:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833752.897710:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787833753.171489:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f29a9da7-4b51-4740-bbc6-5079429f87b0 00000100:00100000:3.0:1787833753.664139:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375637504:0@lo:400:kworker.0 00000100:00100000:3.0:1787833753.664231:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833753.665537:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375637888:0@lo:400:kworker.0 00000100:00100000:2.0:1787833753.665588:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833753.665644:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375637504 00000100:00100000:2.0:1787833753.665651:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375637504 00000100:00100000:2.0:1787833753.665699:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787833753.665708:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375637504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.667570:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375637632:0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.667626:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833753.667656:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375638144:0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.667682:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833753.667701:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833753.667707:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375637760:0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.667726:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833753.667758:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375637632 00000100:00100000:1.0:1787833753.667764:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375637632 00000100:00100000:1.0:1787833753.667817:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375637760 00000100:00100000:1.0:1787833753.667820:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375637760 00000100:00100000:1.0:1787833753.667846:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787833753.667853:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375637632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.667901:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375637632:12345-0@lo:400:kworker.0 Request processed in 48us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833753.667907:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787833753.667926:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787833753.667932:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375637760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.667958:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375637760:12345-0@lo:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833753.667964:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787833753.667983:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833753.668009:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375637760:0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.668019:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375637632:0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.670323:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833753.670363:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375638016:0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.670435:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833753.670486:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375637888 00000100:00100000:1.0:1787833753.670493:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375637888 00000100:00100000:1.0:1787833753.670548:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375638144 00000100:00100000:1.0:1787833753.670551:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375638144 00000100:00100000:1.0:1787833753.670575:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787833753.670584:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375637888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.670638:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375637888:12345-0@lo:400:kworker.0 Request processed in 55us (5049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833753.670645:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787833753.670665:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787833753.670671:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375638144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.670706:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375638144:12345-0@lo:400:kworker.0 Request processed in 35us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833753.670712:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787833753.670731:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833753.670735:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787833753.670760:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6476ebf0c0 x1874679375637888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833753.670787:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375637888:0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.670815:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375638016 00000100:00100000:1.0:1787833753.670819:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375638016 00000100:00100000:1.0:1787833753.670849:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787833753.670855:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375638016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833753.670890:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375638016:12345-0@lo:400:kworker.0 Request processed in 35us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833753.670906:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1787833753.670925:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833753.670942:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375638016:0@lo:400:kworker.0 00010000:00080000:1.0:1787833753.670966:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64623e8b40 x1874679375638144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833753.670976:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375638144:0@lo:400:kworker.0 00000100:00100000:2.0:1787833753.672529:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375637504:12345-0@lo:400:kworker.0 Request processed in 6813us (8289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833753.672557:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787833753.672673:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375637504:0@lo:400:kworker.0 00010000:00010000:1.0:1787833753.916928:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833754.172909:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833754.172940:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375638272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833754.173013:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833754.185704:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375638272 00000100:00100000:1.0:1787833754.185721:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375638272 00000100:00100000:1.0:1787833754.185803:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787833754.185814:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375638272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833754.185854:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833754.185938:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375638272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (12925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833754.185946:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787833754.185994:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6477406940 x1874679375638272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833754.186014:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375638272:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787833754.241291:0:5838:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f29a9da7-4b51-4740-bbc6-5079429f87b0 00000001:00100000:2.0:1787833754.261565:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f29a9da7-4b51-4740-bbc6-5079429f87b0 00010000:00010000:1.0:1787833754.940541:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833755.825768:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833755.825816:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833755.825839:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833755.825857:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833755.825931:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833755.826312:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367217024 00000100:00100000:3.0:1787833755.826322:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367217024 00000100:00100000:3.0:1787833755.826546:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367216896 00000100:00100000:3.0:1787833755.826550:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367216896 00000100:00100000:3.0:1787833755.826572:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:3.0:1787833755.826581:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367217024:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833755.826663:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367217024:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 83us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833755.826671:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:3.0:1787833755.826690:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:3.0:1787833755.826696:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367216896:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833755.826733:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367216896:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 38us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833755.826738:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00080000:3.0:1787833755.826753:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833755.827393:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367217280 00000100:00100000:1.0:1787833755.827400:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367217280 00000100:00100000:1.0:1787833755.827452:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367217152 00000100:00100000:1.0:1787833755.827456:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367217152 00000100:00100000:1.0:1787833755.827479:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:1.0:1787833755.827487:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367217280:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833755.827510:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367216768 00000100:00100000:0.0:1787833755.827514:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367216768 00000100:00100000:0.0:1787833755.827545:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:1.0:1787833755.827547:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367217280:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 61us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833755.827552:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367216768:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833755.827554:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:1.0:1787833755.827571:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:1.0:1787833755.827577:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367217152:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833755.827577:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367216768:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833755.827583:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:1.0:1787833755.827596:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367217152:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 20us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833755.827602:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00080000:3.0:1787833755.827874:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833755.827878:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787833755.968055:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833756.222765:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833756.225477:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375638400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833756.225578:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833756.225792:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375638400 00000100:00100000:1.0:1787833756.225800:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375638400 00000100:00100000:1.0:1787833756.225865:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787833756.225874:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375638400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833756.225914:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833756.225979:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375638400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833756.225988:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787833756.226038:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93ed00 x1874679375638400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833756.226059:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375638400:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787833756.226234:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1787833756.264321:0:10295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787833756.991218:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833758.012696:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833758.786138:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375638528:0@lo:400:kworker.0 00000100:00100000:1.0:1787833758.786224:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833758.786318:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375638528 00000100:00100000:3.0:1787833758.786325:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375638528 00000100:00100000:3.0:1787833758.786393:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787833758.786402:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375638528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833758.795311:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375638528:12345-0@lo:400:kworker.0 Request processed in 8894us (9071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833758.795330:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787833758.795707:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375638784:0@lo:400:kworker.0 00000100:00100000:2.0:1787833758.795768:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833758.795814:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833758.795822:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375638656:0@lo:400:kworker.0 00000100:00100000:2.0:1787833758.795845:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833758.795987:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375638784 00000100:00100000:3.0:1787833758.795995:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375638784 00000100:00100000:3.0:1787833758.796054:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375638656 00000100:00100000:3.0:1787833758.796057:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375638656 00000100:00100000:0.0:1787833758.796062:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375638912:0@lo:400:kworker.0 00000100:00100000:3.0:1787833758.796078:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787833758.796086:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477406d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375638784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833758.796096:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833758.796150:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477406d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375638784:12345-0@lo:400:kworker.0 Request processed in 64us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833758.796156:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787833758.796202:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833758.796209:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375639040:0@lo:400:kworker.0 00000100:00100000:0.0:1787833758.796235:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787833758.796259:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833758.796270:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375639168:0@lo:400:kworker.0 00000100:00100000:2.0:1787833758.796302:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833758.796363:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375638784:0@lo:400:kworker.0 00000100:00100000:3.0:1787833758.796423:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787833758.796432:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375638656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833758.796469:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375638656:12345-0@lo:400:kworker.0 Request processed in 39us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833758.796475:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787833758.796486:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375639040 00000100:00100000:3.0:1787833758.796489:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375639040 00000100:00100000:3.0:1787833758.796510:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787833758.796767:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375639040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833758.796814:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375639040:12345-0@lo:400:kworker.0 Request processed in 51us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833758.796821:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787833758.796843:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833758.796863:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375638656:0@lo:400:kworker.0 00000100:00100000:2.0:1787833758.796988:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375639040:0@lo:400:kworker.0 00000100:00100000:1.0:1787833758.797122:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375638528:0@lo:400:kworker.0 00000100:00100000:1.0:1787833758.797162:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375638912 00000100:00100000:1.0:1787833758.797166:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375638912 00000100:00100000:1.0:1787833758.797309:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375639168 00000100:00100000:1.0:1787833758.797313:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375639168 00000100:00100000:2.0:1787833758.797471:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787833758.797480:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375638912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833758.797524:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375638912:12345-0@lo:400:kworker.0 Request processed in 46us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833758.797536:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787833758.797590:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93e580 x1874679375638912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833758.797602:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375638912:0@lo:400:kworker.0 00000100:00080000:3.0:1787833758.797714:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833758.797718:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833758.797817:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787833758.797824:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375639168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833758.797866:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375639168:12345-0@lo:400:kworker.0 Request processed in 42us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833758.797872:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787833758.798016:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93c000 x1874679375639168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833758.798028:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375639168:0@lo:400:kworker.0 00010000:00010000:3.0:1787833759.044690:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833759.294989:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375639296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833759.295081:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833759.295181:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375639296 00000100:00100000:1.0:1787833759.295189:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375639296 00000100:00100000:1.0:1787833759.295232:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787833759.295241:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375639296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833759.295273:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833759.295317:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375639296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833759.295326:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787833759.295385:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6477404000 x1874679375639296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833759.295415:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375639296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787833760.067279:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833760.945907:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833760.945957:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833760.945990:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833760.946013:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833760.946039:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833760.946068:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367217408 00000100:00100000:0.0:1787833760.946076:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367217408 00000100:00100000:0.0:1787833760.946137:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 222 00000100:00100000:0.0:1787833760.946147:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2346:x1874679367217408:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833760.946218:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2346:x1874679367217408:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833760.946226:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 222 00000100:00100000:0.0:1787833760.946261:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367217536 00000100:00100000:0.0:1787833760.946265:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367217536 00000100:00100000:0.0:1787833760.946301:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367217664 00000100:00100000:0.0:1787833760.946304:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367217664 00000100:00100000:0.0:1787833760.946325:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:0.0:1787833760.946332:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367217536:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833760.946385:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367217536:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 52us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833760.946392:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:0.0:1787833760.946404:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:0.0:1787833760.946410:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367217664:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833760.946433:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367217664:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 23us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833760.946439:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:0.0:1787833760.946457:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367217792 00000100:00100000:0.0:1787833760.946466:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367217792 00000100:00100000:0.0:1787833760.946496:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367217920 00000100:00100000:0.0:1787833760.946499:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367217920 00000100:00100000:0.0:1787833760.946520:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787833760.946527:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367217792:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833760.946553:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367217792:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833760.946559:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787833760.946569:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:0.0:1787833760.946575:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367217920:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833760.946594:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367217920:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 20us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833760.946600:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00080000:0.0:1787833760.946736:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833760.946739:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833760.946741:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787833761.085540:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833761.342651:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375639424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833761.342712:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833761.342811:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375639424 00000100:00100000:1.0:1787833761.342820:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375639424 00000100:00100000:1.0:1787833761.342893:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787833761.342903:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375639424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833761.342937:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787833761.343003:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833761.345752:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375639424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2844us (3032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833761.345763:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787833761.348258:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f93fc00 x1874679375639424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833761.348291:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375639424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787833762.109308:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833763.132954:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833763.901032:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375639552:0@lo:400:kworker.0 00000100:00100000:0.0:1787833763.901036:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375639680:0@lo:400:kworker.0 00000100:00100000:1.0:1787833763.901142:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375639808:0@lo:400:kworker.0 00000100:00100000:3.0:1787833763.901172:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833763.901192:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375639936:0@lo:400:kworker.0 00000100:00100000:2.0:1787833763.901222:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833763.901252:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833763.901258:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375640064:0@lo:400:kworker.0 00000100:00100000:2.0:1787833763.901282:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833763.901559:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375639552 00000100:00100000:3.0:1787833763.901566:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375639552 00000100:00100000:3.0:1787833763.901604:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787833763.901612:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375639552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833763.901905:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375639552:12345-0@lo:400:kworker.0 Request processed in 293us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833763.901926:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787833763.901971:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375639552:0@lo:400:kworker.0 00000100:00100000:0.0:1787833763.904045:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833763.904100:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375640192:0@lo:400:kworker.0 00000100:00100000:0.0:1787833763.904131:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833763.904159:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375639936 00000100:00100000:0.0:1787833763.904164:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375639936 00000100:00100000:0.0:1787833763.904200:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375640192 00000100:00100000:0.0:1787833763.904202:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375640192 00000100:00100000:0.0:1787833763.904218:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787833763.904223:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375639936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833763.904262:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375639936:12345-0@lo:400:kworker.0 Request processed in 39us (3040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833763.904280:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787833763.904296:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787833763.904302:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646eff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375640192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833763.904365:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646eff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375640192:12345-0@lo:400:kworker.0 Request processed in 38us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833763.904372:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787833763.904525:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375640064 00000100:00100000:0.0:1787833763.904529:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375640064 00000100:00100000:0.0:1787833763.904551:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375639680 00000100:00100000:0.0:1787833763.904553:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375639680 00000100:00100000:0.0:1787833763.904568:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787833763.904572:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375640064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833763.904585:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787833763.904600:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375640064:12345-0@lo:400:kworker.0 Request processed in 25us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833763.904601:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375639680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833763.904611:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787833763.904627:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833763.904631:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833763.904633:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833763.904652:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375639680:12345-0@lo:400:kworker.0 Request processed in 57us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833763.904659:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787833763.904673:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375640064:0@lo:400:kworker.0 00010000:00080000:0.0:1787833763.904689:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64623e8f00 x1874679375639936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833763.904700:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375639936:0@lo:400:kworker.0 00010000:00080000:0.0:1787833763.904729:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6476ebe940 x1874679375640192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833763.904737:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375640192:0@lo:400:kworker.0 00000100:00100000:0.0:1787833763.904753:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375639680:0@lo:400:kworker.0 00000100:00100000:0.0:1787833763.905640:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833763.906774:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375639808 00000100:00100000:2.0:1787833763.906783:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375639808 00000100:00080000:0.0:1787833763.906858:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833763.906936:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787833763.906947:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375639808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833763.907042:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375639808:12345-0@lo:400:kworker.0 Request processed in 97us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833763.907049:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787833763.907093:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375639808:0@lo:400:kworker.0 00010000:00010000:1.0:1787833764.157108:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833764.413235:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375640320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833764.413310:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833764.413496:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375640320 00000100:00100000:3.0:1787833764.413507:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375640320 00000100:00100000:3.0:1787833764.413557:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787833764.413566:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375640320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833764.413599:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833764.416498:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375640320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2925us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833764.416513:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787833764.417103:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa143c0 x1874679375640320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833764.417131:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375640320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787833765.185063:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833766.066109:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833766.066147:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833766.066176:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833766.066212:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833766.066237:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833766.066265:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367218432 00000100:00100000:1.0:1787833766.066273:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367218432 00000100:00100000:1.0:1787833766.066330:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367218560 00000100:00100000:1.0:1787833766.066333:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367218560 00000100:00100000:1.0:1787833766.066375:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:1.0:1787833766.066393:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367218432:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833766.066469:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367218432:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 78us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833766.066477:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:1.0:1787833766.066494:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787833766.066500:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367218560:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833766.066523:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367218560:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833766.066529:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787833766.066546:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367218048 00000100:00100000:1.0:1787833766.066549:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367218048 00000100:00100000:1.0:1787833766.066576:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 224 00000100:00100000:1.0:1787833766.066582:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367218048:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833766.066603:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367218048:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 23us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833766.066609:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 224 00000100:00100000:1.0:1787833766.066635:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367218176 00000100:00100000:1.0:1787833766.066638:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367218176 00000100:00100000:1.0:1787833766.066663:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367218304 00000100:00100000:1.0:1787833766.066666:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367218304 00000100:00100000:1.0:1787833766.066690:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:1.0:1787833766.066696:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367218176:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833766.066724:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367218176:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833766.066730:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:1.0:1787833766.066748:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:1.0:1787833766.066755:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367218304:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833766.066779:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367218304:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833766.066785:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00080000:1.0:1787833766.066803:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833766.066807:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833766.066809:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787833766.207564:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833766.467329:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833766.467383:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375640448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833766.467451:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833766.467638:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375640448 00000100:00100000:1.0:1787833766.467647:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375640448 00000100:00100000:1.0:1787833766.467714:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787833766.467723:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375640448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833766.467759:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833766.467806:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375640448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833766.467813:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787833766.467870:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833766.467904:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6476ebda40 x1874679375640448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833766.467923:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375640448:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787833767.229194:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833768.252945:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833769.020569:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375640704:0@lo:400:kworker.0 00000100:00100000:1.0:1787833769.020680:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375640960:0@lo:400:kworker.0 00000100:00100000:1.0:1787833769.020750:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833769.020806:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787833769.020813:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375640576:0@lo:400:kworker.0 00000100:00100000:1.0:1787833769.020843:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833769.020872:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375641088:0@lo:400:kworker.0 00000100:00100000:1.0:1787833769.020897:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833769.020946:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375640960 00000100:00100000:1.0:1787833769.020953:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375640960 00000100:00100000:1.0:1787833769.021018:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787833769.021028:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375640960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833769.021089:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375640960:12345-0@lo:400:kworker.0 Request processed in 62us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833769.021096:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787833769.021137:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa16580 x1874679375640960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833769.021151:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375640960:0@lo:400:kworker.0 00000100:00100000:0.0:1787833769.021430:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375641088 00000100:00100000:0.0:1787833769.021435:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375641088 00000100:00100000:0.0:1787833769.021473:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787833769.021481:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375641088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833769.021524:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375641088:12345-0@lo:400:kworker.0 Request processed in 44us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833769.021532:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787833769.021560:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375641088:0@lo:400:kworker.0 00000100:00100000:3.0:1787833769.021809:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833769.021870:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375641216:0@lo:400:kworker.0 00000100:00100000:3.0:1787833769.021895:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833769.021917:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833769.021923:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375640832:0@lo:400:kworker.0 00000100:00100000:3.0:1787833769.021945:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833769.024799:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375640576 00000100:00100000:3.0:1787833769.024812:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375640576 00000100:00100000:3.0:1787833769.024866:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787833769.024875:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375640576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833769.024941:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375640576:12345-0@lo:400:kworker.0 Request processed in 68us (4098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833769.024948:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1787833769.024981:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833769.024988:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833769.024998:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375641216 00000100:00100000:3.0:1787833769.025002:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375641216 00000100:00100000:3.0:1787833769.025048:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787833769.025055:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375641216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833769.025093:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375641216:12345-0@lo:400:kworker.0 Request processed in 39us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833769.025109:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833769.026723:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375640704 00000100:00100000:0.0:1787833769.026735:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375640704 00000100:00100000:0.0:1787833769.026789:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375640832 00000100:00100000:0.0:1787833769.026793:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375640832 00000100:00100000:0.0:1787833769.026817:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787833769.026825:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375640704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833769.026892:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375640704:12345-0@lo:400:kworker.0 Request processed in 68us (5082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833769.026899:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787833769.026914:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787833769.026921:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375640832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833769.026950:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375640832:12345-0@lo:400:kworker.0 Request processed in 30us (5005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833769.026966:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1787833769.027403:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787833769.027408:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833769.027440:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375640576:0@lo:400:kworker.0 00000100:00100000:3.0:1787833769.027479:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375640832:0@lo:400:kworker.0 00000100:00100000:3.0:1787833769.027491:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375640704:0@lo:400:kworker.0 00010000:00080000:3.0:1787833769.027504:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64623e9680 x1874679375641216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833769.027515:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375641216:0@lo:400:kworker.0 00010000:00010000:3.0:1787833769.276854:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833769.536088:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375641344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833769.536147:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833769.536255:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375641344 00000100:00100000:1.0:1787833769.536263:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375641344 00000100:00100000:1.0:1787833769.536310:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787833769.536320:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375641344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833769.536378:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833769.536422:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375641344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833769.536429:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787833769.536462:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64623e9680 x1874679375641344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833769.536476:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375641344:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787833770.302330:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833771.183622:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833771.183671:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833771.183695:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833771.183717:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833771.183745:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833771.183775:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367218944 00000100:00100000:0.0:1787833771.183785:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367218944 00000100:00100000:0.0:1787833771.183836:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367218816 00000100:00100000:0.0:1787833771.183839:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367218816 00000100:00100000:0.0:1787833771.183861:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:0.0:1787833771.183870:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367218944:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833771.183952:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367218944:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 83us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833771.183960:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:0.0:1787833771.183978:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:0.0:1787833771.183985:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367218816:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833771.184020:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367218816:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833771.184026:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:0.0:1787833771.184044:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367219072 00000100:00100000:0.0:1787833771.184047:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367219072 00000100:00100000:0.0:1787833771.184066:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367219200 00000100:00100000:0.0:1787833771.184068:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367219200 00000100:00100000:0.0:1787833771.184082:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787833771.184088:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2343:x1874679367219072:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:0.0:1787833771.184115:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774daf 00000100:00080000:0.0:1787833771.184123:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b646e1c8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787833771.184169:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787833771.184503:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+2:2343:x1874679367219072:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 414us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833771.184511:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787833771.184525:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787833771.184532:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2343:x1874679367219200:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:0.0:1787833771.184544:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774db6 00000100:00080000:0.0:1787833771.184548:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b634133f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787833771.184568:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787833771.184728:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+2:2343:x1874679367219200:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 196us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833771.184735:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:3.0:1787833771.185233:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367218688 00000100:00100000:3.0:1787833771.185239:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367218688 00000100:00100000:3.0:1787833771.185283:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 226 00000100:00100000:3.0:1787833771.185292:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367218688:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833771.185331:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367218688:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 42us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833771.185358:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 226 00000100:00080000:3.0:1787833771.185388:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833771.185393:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833771.185395:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787833771.185413:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833771.185501:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833771.325421:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833771.580573:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833771.580598:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375641472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833771.580674:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833771.580791:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375641472 00000100:00100000:3.0:1787833771.580811:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375641472 00000100:00100000:3.0:1787833771.580888:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787833771.580898:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477406580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375641472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833771.580933:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833771.580981:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477406580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375641472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833771.581001:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787833771.581130:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787833771.581157:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64623e83c0 x1874679375641472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833771.581175:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375641472:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787833771.740938:0:10996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787833772.348782:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833773.373184:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787833773.673627:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f29a9da7-4b51-4740-bbc6-5079429f87b0 00000020:00000080:0.0:1787833773.673637:0:6686:0:(genops.c:885:class_export_put()) final put ffff9b646e1ca000/f29a9da7-4b51-4740-bbc6-5079429f87b0 00000020:00000080:3.0:1787833773.673721:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b646e1ca000/f29a9da7-4b51-4740-bbc6-5079429f87b0 for lustre-OST0000 00000020:00000080:3.0:1787833773.673772:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b646e1c8800 for lustre-OST0000 00000100:00100000:1.0:1787833774.140887:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375641856:0@lo:400:kworker.0 00000100:00100000:1.0:1787833774.140986:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.141054:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787833774.141060:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375641728:0@lo:400:kworker.0 00000100:00100000:1.0:1787833774.141082:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.141115:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375642240:0@lo:400:kworker.0 00000100:00100000:1.0:1787833774.141142:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.141179:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375641856 00000100:00100000:1.0:1787833774.141186:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375641856 00000100:00100000:1.0:1787833774.141236:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375641728 00000100:00100000:1.0:1787833774.141239:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375641728 00000100:00100000:1.0:1787833774.141257:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787833774.141371:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375641984:0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.141404:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.141429:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787833774.141435:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375641600:0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.141466:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.141500:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375642112:0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.141524:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833774.141548:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375642112 00000100:00100000:3.0:1787833774.141552:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375642112 00000100:00100000:3.0:1787833774.141574:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787833774.141581:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375641728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.141638:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375641728:12345-0@lo:400:kworker.0 Request processed in 56us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.141646:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787833774.141661:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787833774.141668:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375642112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.141711:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375642112:12345-0@lo:400:kworker.0 Request processed in 44us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.141718:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787833774.141742:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375642240 00000100:00100000:3.0:1787833774.141745:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375642240 00000100:00100000:3.0:1787833774.141771:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375641984 00000100:00100000:3.0:1787833774.141774:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375641984 00000100:00100000:3.0:1787833774.141793:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787833774.141800:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375642240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.141833:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375642240:12345-0@lo:400:kworker.0 Request processed in 33us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.141840:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787833774.141851:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787833774.141856:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375641984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.141883:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375641984:12345-0@lo:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.141890:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787833774.141907:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375641600 00000100:00100000:3.0:1787833774.141911:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375641600 00000100:00100000:3.0:1787833774.141934:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787833774.141939:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375641600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.141988:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375641600:12345-0@lo:400:kworker.0 Request processed in 48us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.141994:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787833774.142047:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375641600:0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.142061:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375642112:0@lo:400:kworker.0 00010000:00080000:3.0:1787833774.142080:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa143c0 x1874679375641984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833774.142090:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375641984:0@lo:400:kworker.0 00000100:00100000:3.0:1787833774.142150:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375641728:0@lo:400:kworker.0 00010000:00080000:3.0:1787833774.142161:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647fa15680 x1874679375642240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833774.142169:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375642240:0@lo:400:kworker.0 00000100:00100000:1.0:1787833774.142461:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375641856:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787833774.142658:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833774.142663:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833774.142666:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833774.142801:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375641856:12345-0@lo:400:kworker.0 Request processed in 1535us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833774.142808:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787833774.148128:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375641856:0@lo:400:kworker.0 00010000:00010000:3.0:1787833774.399098:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833774.656018:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375642368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833774.656089:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833774.656490:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375642368 00000100:00100000:2.0:1787833774.656499:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375642368 00000100:00100000:2.0:1787833774.656548:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787833774.656558:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375642368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833774.656594:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833774.658762:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375642368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2197us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.658846:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787833774.658927:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6477405680 x1874679375642368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833774.658952:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375642368:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787833774.762063:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f29a9da7-4b51-4740-bbc6-5079429f87b0 00000020:00000080:2.0:1787833774.762072:0:7626:0:(genops.c:885:class_export_put()) final put ffff9b634133b800/f29a9da7-4b51-4740-bbc6-5079429f87b0 00000020:00000080:3.0:1787833774.762209:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b634133b800/f29a9da7-4b51-4740-bbc6-5079429f87b0 for lustre-OST0001 00000020:00000080:3.0:1787833774.762518:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b634133f000 for lustre-OST0001 00000020:00000080:3.0:1787833774.866325:0:11147:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe36263880 20000000:00000080:3.0:1787833774.866364:0:11147:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b64774b2800 uarg=0000000000000000 20000000:01000000:3.0:1787833774.866404:0:11147:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787833774.866410:0:11147:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787833774.866415:0:11147:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787833774.872107:0:11148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787833774.872503:0:11147:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787833774.880679:0:11147:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787833774.881111:0:11147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.881144:0:11147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39cb expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.881154:0:11147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d69 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.881190:0:11147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d77 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.881197:0:11147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774d85 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.881204:0:11147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a03 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.881211:0:11147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.881255:0:11147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a03 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.881271:0:11147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a03 expref: 12 pid: 5807 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833774.881286:0:11147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375642496:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833774.881414:0:11147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774d85 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.881422:0:11147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d85 expref: 18 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833774.881431:0:11147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375642624:0@lo:104: 00000100:00100000:3.0:1787833774.881473:0:11147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.881663:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375642624 00000100:00100000:1.0:1787833774.881670:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375642624 00000100:00100000:1.0:1787833774.881721:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787833774.881730:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:11147:x1874679375642624:12345-0@lo:104: 00010000:00010000:1.0:1787833774.881742:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.881793:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833774.881811:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:11147:x1874679375642624:12345-0@lo:104: Request processed in 83us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.881819:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787833774.881842:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833774.881848:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.881855:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82000 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833774.881859:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.881880:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833774.881888:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833774.881893:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787833774.881919:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.881925:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833774.881946:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.881963:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82000/0x2bdb54ee5e774d85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774d8c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.881978:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833774.881980:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833774.881981:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833774.881993:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375642752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833774.882022:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.882063:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375642752 00000100:00100000:1.0:1787833774.882067:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375642752 00010000:00010000:1.0:1787833774.882084:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d85 expref: 19 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833774.882107:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787833774.882114:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644600b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375642752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833774.882130:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833774.882135:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d85 expref: 19 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.882144:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d85 expref: 19 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.882174:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833774.882202:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644600b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375642752:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.882209:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787833774.882282:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375642752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833774.882915:0:11147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774d77 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.882934:0:11147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d77 expref: 18 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833774.882945:0:11147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa15680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375642880:0@lo:104: 00000100:00100000:3.0:1787833774.882984:0:11147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787833774.883051:0:11147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774d69 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.883059:0:11147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d69 expref: 18 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833774.883067:0:11147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa15e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375643008:0@lo:104: 00000100:00100000:3.0:1787833774.883087:0:11147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787833774.884502:0:11147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39cb expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833774.884528:0:11147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39cb expref: 12 pid: 5810 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833774.884540:0:11147:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375643136:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833774.884595:0:11147:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647f982180 going to sleep for 11 seconds 00010000:00010000:3.0:1787833774.884615:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440031e00/0x2bdb54ee5e774d8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774d85 expref: 18 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833774.884626:0:11147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375642624:0@lo:104: 00000100:00100000:1.0:1787833774.884919:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375642880 00000100:00100000:1.0:1787833774.884928:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375642880 00000100:00100000:1.0:1787833774.884977:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375643008 00000100:00100000:1.0:1787833774.884980:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375643008 00000100:00100000:1.0:1787833774.884994:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833774.885001:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:11147:x1874679375642880:12345-0@lo:104: 00010000:00010000:1.0:1787833774.885013:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885138:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833774.885145:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:11147:x1874679375642880:12345-0@lo:104: Request processed in 144us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.885152:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833774.885181:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787833774.885188:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:11147:x1874679375643008:12345-0@lo:104: 00010000:00010000:1.0:1787833774.885196:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885239:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787833774.885244:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:11147:x1874679375643008:12345-0@lo:104: Request processed in 58us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.885250:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787833774.885688:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787833774.885695:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885702:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c800 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833774.885707:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885715:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833774.885723:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833774.885729:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787833774.885766:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885772:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833774.885896:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885905:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c800/0x2bdb54ee5e774d77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774d7e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885926:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833774.885930:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885935:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031800 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833774.885939:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885945:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833774.885951:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833774.885966:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787833774.885980:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.885985:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833774.886001:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.886008:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6440031800/0x2bdb54ee5e774d69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774d70 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.886021:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833774.886023:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833774.886024:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833774.886030:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833774.886048:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375643392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833774.886080:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.886228:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375643392 00000100:00100000:1.0:1787833774.886234:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375643392 00010000:00010000:1.0:1787833774.886255:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d69 expref: 18 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833774.886280:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787833774.886286:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342375680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3282:x1874679375643392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833774.886297:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833774.886301:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d69 expref: 18 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.886310:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d69 expref: 18 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.886325:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833774.886370:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342375680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3282:x1874679375643392:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.886376:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787833774.886403:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375643392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833774.886421:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833774.886429:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375643264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833774.886449:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833774.886470:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375643264 00000100:00100000:1.0:1787833774.886473:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375643264 00010000:00010000:1.0:1787833774.886485:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d77 expref: 18 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833774.886564:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787833774.886571:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342374f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3280:x1874679375643264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833774.886579:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833774.886584:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d77 expref: 18 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.886592:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774d77 expref: 18 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.886602:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833774.886634:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342374f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3280:x1874679375643264:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.886640:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787833774.886759:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375643264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833774.887051:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774d7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774d77 expref: 17 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833774.887073:0:11147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa15680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375642880:0@lo:104: 00010000:00010000:3.0:1787833774.887405:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e774d70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774d69 expref: 16 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833774.887415:0:11147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa15e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375643008:0@lo:104: 00000100:00100000:1.0:1787833774.887643:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833774.887771:0:11147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375642496:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833774.887913:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367219328 00000100:00100000:2.0:1787833774.887919:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367219328 00010000:00010000:2.0:1787833774.887942:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a03 expref: 13 pid: 5807 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833774.888008:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:2.0:1787833774.888016:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2345:x1874679367219328:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833774.888035:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833774.888041:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a03 expref: 13 pid: 5807 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.888051:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a03 expref: 13 pid: 5807 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.888064:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462199800/0x2bdb54ee5e774da1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a03 expref: 13 pid: 5807 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833774.888074:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833774.888133:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:2345:x1874679367219328:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 117us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833774.888141:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:3.0:1787833774.888327:0:11147:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11147:1874679375643136:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833774.888383:0:11147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833774.888441:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833774.895508:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367219456 00000100:00100000:1.0:1787833774.895524:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367219456 00010000:00010000:1.0:1787833774.895573:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39cb expref: 12 pid: 5810 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833774.895604:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787833774.895613:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7dee5a5-62c8-47df-824e-7aea04306fca+12:2344:x1874679367219456:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833774.895628:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833774.895633:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39cb expref: 12 pid: 5810 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895647:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39cb expref: 12 pid: 5810 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895682:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774d62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39cb expref: 12 pid: 5810 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895698:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895707:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895723:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895730:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895736:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895743:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895947:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833774.895962:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895973:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.895999:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833774.896021:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833774.896088:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7dee5a5-62c8-47df-824e-7aea04306fca+11:2344:x1874679367219456:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 474us (7647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833774.896096:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00010000:00010000:0.0:1787833774.896251:0:11147:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.896261:0:11147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833774.896268:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2d000/0x2bdb54ee5e774dbd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833775.421301:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833776.110567:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833776.110738:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367219584 00000100:00100000:0.0:1787833776.110748:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367219584 00000100:00100000:0.0:1787833776.110804:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 228 00000100:00100000:0.0:1787833776.110815:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+11:5589:x1874679367219584:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833776.110831:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833776.110851:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a2d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833776.110880:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a2d expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833776.110891:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a2d expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833776.110899:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b64821c4200, rc 0) 00000100:00100000:0.0:1787833776.110978:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367219584:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 165us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833776.110985:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 228 00000100:00100000:1.0:1787833776.115429:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833776.115561:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367219712 00000100:00100000:3.0:1787833776.115572:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367219712 00000100:00100000:3.0:1787833776.115628:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:3.0:1787833776.115637:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367219712:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.115973:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367219712:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 336us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833776.115982:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:1.0:1787833776.128094:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833776.128239:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367219840 00000100:00100000:3.0:1787833776.128260:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367219840 00000100:00100000:3.0:1787833776.128319:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 230 00000100:00100000:3.0:1787833776.128330:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367219840:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.128574:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367219840:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 246us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833776.128592:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 230 00000100:00100000:0.0:1787833776.144839:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833776.145666:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367219968 00000100:00100000:3.0:1787833776.145676:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367219968 00000100:00100000:3.0:1787833776.145740:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:3.0:1787833776.145750:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367219968:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833776.145767:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833776.145784:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a34 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.145810:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a34 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.145820:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a34 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.145828:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c200, rc 0) 00000100:00100000:3.0:1787833776.145892:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367219968:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 145us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833776.145900:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:3.0:1787833776.148376:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833776.149049:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367220096 00000100:00100000:1.0:1787833776.149059:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367220096 00000100:00100000:1.0:1787833776.149120:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 232 00000100:00100000:1.0:1787833776.149130:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367220096:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833776.149454:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367220096:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 325us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833776.149463:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 232 00000100:00100000:0.0:1787833776.167498:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833776.170258:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367220224 00000100:00100000:2.0:1787833776.170269:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367220224 00000100:00100000:2.0:1787833776.170329:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00100000:2.0:1787833776.170360:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367220224:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833776.170582:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367220224:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 244us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833776.170590:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00100000:0.0:1787833776.304621:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833776.304714:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367220352 00000100:00100000:3.0:1787833776.304725:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367220352 00000100:00100000:3.0:1787833776.304799:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:3.0:1787833776.304810:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367220352:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833776.304888:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367220352:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833776.304918:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00080000:2.0:1787833776.304979:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833776.305544:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833776.305605:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367220480 00000100:00100000:0.0:1787833776.305611:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367220480 00000100:00100000:0.0:1787833776.305657:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:0.0:1787833776.305666:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2345:x1874679367220480:12345-192.168.202.15@tcp:400:kworker.0 00000100:00080000:2.0:1787833776.305761:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833776.305791:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2345:x1874679367220480:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 124us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833776.305808:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00010000:00010000:1.0:1787833776.444536:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787833776.518003:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787833776.518011:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b647fa63000 from 7 10000000:01000000:1.0:1787833776.518017:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833776.518128:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.518141:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.518152:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833776.518176:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375643520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833776.518435:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833776.519163:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647f9b0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833776.524732:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375643520 00000100:00100000:3.0:1787833776.524748:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375643520 00000100:00100000:3.0:1787833776.524807:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787833776.524966:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375643520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833776.524985:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833776.525003:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774dd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.525030:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774dd2 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.525041:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774dd2 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.525051:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2d400, rc 0) 00000100:00100000:3.0:1787833776.525199:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375643520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (6763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833776.525206:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787833776.525300:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375643520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833776.525318:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833776.525415:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833776.525555:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375643648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.525589:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833776.525618:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647f982540 going to sleep for 11 seconds 00000100:00100000:3.0:1787833776.525631:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375643648 00000100:00100000:3.0:1787833776.525635:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375643648 00000100:00100000:3.0:1787833776.525700:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787833776.525708:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375643648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.526032:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375643648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833776.526040:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787833776.526174:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375643648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.526209:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375643776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.526246:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833776.526301:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647f982540 going to sleep for 11 seconds 00000100:00100000:2.0:1787833776.526412:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375643776 00000100:00100000:2.0:1787833776.526417:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375643776 00000100:00100000:3.0:1787833776.526537:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787833776.526545:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375643776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.526685:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375643776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833776.526692:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787833776.526765:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375643776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787833776.529018:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787833776.529290:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787833776.529312:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833776.529322:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.529333:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833776.529551:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833776.529557:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b64773a1800 from 7 10000000:01000000:3.0:1787833776.529560:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833776.529594:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.529613:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.529624:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833776.529649:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375643904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.529708:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833776.529747:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b645067c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787833776.529770:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375643904 00000100:00100000:1.0:1787833776.529777:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375643904 00000100:00100000:1.0:1787833776.529825:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787833776.529834:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375643904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833776.529847:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833776.529859:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774de0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.529881:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774de0 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.529891:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774de0 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.529911:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198400, rc 0) 00000100:00100000:1.0:1787833776.529959:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375643904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833776.529966:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787833776.530009:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375643904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833776.530023:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.530033:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833776.530203:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833776.530292:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833776.530310:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647f9b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787833776.530325:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375644032 00000100:00100000:1.0:1787833776.530328:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375644032 00000100:00100000:1.0:1787833776.530378:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787833776.530384:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375644032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833776.530610:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375644032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833776.530616:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787833776.531021:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.531058:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.531097:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833776.531128:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b645067c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833776.531133:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375644160 00000100:00100000:0.0:1787833776.531138:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375644160 00000100:00100000:0.0:1787833776.531174:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787833776.531181:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375644160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833776.531451:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375644160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833776.531458:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787833776.531540:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787833776.533627:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787833776.533930:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787833776.533963:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833776.533974:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.533986:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833776.533995:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787833776.533998:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6460630000 from 7 10000000:01000000:1.0:1787833776.534000:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833776.534031:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.534039:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.534101:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833776.534124:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833776.534186:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833776.534227:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647f9b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1787833776.534470:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375644288 00000100:00100000:3.0:1787833776.534476:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375644288 00000100:00100000:3.0:1787833776.534520:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787833776.534529:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375644288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833776.534541:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833776.534552:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774dee expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.534573:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774dee expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.534595:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774dee expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.534603:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c400, rc 0) 00000100:00100000:3.0:1787833776.534640:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375644288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833776.534647:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787833776.534686:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833776.534699:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833776.534708:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833776.534753:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.534775:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833776.534787:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b645067c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833776.534799:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375644416 00000100:00100000:3.0:1787833776.534802:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375644416 00000100:00100000:3.0:1787833776.534818:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787833776.534823:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375644416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833776.535322:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375644416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 496us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833776.535330:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787833776.535445:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833776.535479:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833776.535517:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833776.535540:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647f9b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833776.535554:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375644544 00000100:00100000:1.0:1787833776.535558:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375644544 00000100:00100000:1.0:1787833776.535579:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787833776.535585:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+20:5812:x1874679375644544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833776.535721:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+20:5812:x1874679375644544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833776.535727:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787833776.535767:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342376d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375644544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787833776.538006:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787833776.538230:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787833776.538310:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833776.538321:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833776.538333:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833776.700617:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833776.700643:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375644672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833776.700716:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833776.700858:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375644672 00000100:00100000:2.0:1787833776.700866:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375644672 00000100:00100000:2.0:1787833776.700933:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787833776.700953:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375644672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833776.700990:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833776.701045:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375644672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833776.701065:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787833776.701108:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6477405680 x1874679375644672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833776.701127:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375644672:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787833776.701303:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787833777.469270:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833778.498845:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787833778.924987:0:11344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787833779.262218:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375644800:0@lo:400:kworker.0 00000100:00100000:1.0:1787833779.262300:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833779.262382:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833779.262389:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375644928:0@lo:400:kworker.0 00000100:00100000:1.0:1787833779.262419:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833779.262461:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375645184:0@lo:400:kworker.0 00000100:00100000:1.0:1787833779.262490:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833779.262507:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833779.262512:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375645056:0@lo:400:kworker.0 00000100:00100000:1.0:1787833779.262545:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833779.262580:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375644800 00000100:00100000:1.0:1787833779.262588:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375644800 00000100:00100000:1.0:1787833779.262630:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787833779.262639:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375644800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833779.262691:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375644800:12345-0@lo:400:kworker.0 Request processed in 54us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833779.262699:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787833779.262729:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375644928 00000100:00100000:2.0:1787833779.262856:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375645440:0@lo:400:kworker.0 00000100:00100000:2.0:1787833779.262961:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833779.262984:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833779.262989:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375645312:0@lo:400:kworker.0 00000100:00100000:2.0:1787833779.263011:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833779.263042:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375645056 00000100:00100000:2.0:1787833779.263045:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375645056 00000100:00100000:2.0:1787833779.263090:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375645312 00000100:00100000:2.0:1787833779.263093:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375645312 00000100:00100000:2.0:1787833779.263119:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787833779.263126:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375645056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833779.263206:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787833779.263216:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375645312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833779.263260:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375645312:12345-0@lo:400:kworker.0 Request processed in 46us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833779.263266:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787833779.263318:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375645184 00000100:00100000:3.0:1787833779.263330:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375645184 00000100:00100000:3.0:1787833779.263383:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375645440 00000100:00100000:2.0:1787833779.263387:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375645056:12345-0@lo:400:kworker.0 Request processed in 259us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833779.263388:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375645440 00000100:00100000:2.0:1787833779.263397:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787833779.263411:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375645056:0@lo:400:kworker.0 00000100:00100000:3.0:1787833779.263420:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787833779.263421:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833779.263427:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833779.263431:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833779.263432:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b63423752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375645184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833779.263457:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375645312:0@lo:400:kworker.0 00000100:00100000:3.0:1787833779.263484:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b63423752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375645184:12345-0@lo:400:kworker.0 Request processed in 54us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833779.263494:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787833779.263511:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6477404780 x1874679375645184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833779.263521:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375645184:0@lo:400:kworker.0 00000100:00100000:3.0:1787833779.263526:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787833779.263536:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477406940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375645440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833779.263576:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477406940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375645440:12345-0@lo:400:kworker.0 Request processed in 43us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833779.263582:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787833779.263594:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6477407840 x1874679375645440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833779.263611:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375645440:0@lo:400:kworker.0 00000100:00100000:1.0:1787833779.264051:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375644928 00000100:00100000:1.0:1787833779.264101:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787833779.264110:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375644928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833779.264210:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375644928:12345-0@lo:400:kworker.0 Request processed in 101us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833779.264216:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787833779.264249:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375644928:0@lo:400:kworker.0 00000100:00100000:1.0:1787833779.264259:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375644800:0@lo:400:kworker.0 00010000:00010000:1.0:1787833779.516580:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833779.772668:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375645568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833779.772747:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833779.773302:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375645568 00000100:00100000:3.0:1787833779.773311:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375645568 00000100:00100000:3.0:1787833779.773380:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787833779.773390:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375645568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833779.773428:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833779.773481:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459049a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375645568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833779.773488:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787833779.773762:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6477404000 x1874679375645568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833779.773781:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375645568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787833780.543857:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833781.424170:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833781.424215:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833781.424270:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833781.424400:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367220864 00000100:00100000:2.0:1787833781.424414:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367220864 00000100:00100000:2.0:1787833781.424501:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367220736 00000100:00100000:2.0:1787833781.424504:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367220736 00000100:00100000:2.0:1787833781.424532:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787833781.424543:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477617840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2345:x1874679367220864:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833781.424648:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477617840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2345:x1874679367220864:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 107us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833781.424657:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787833781.424675:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:2.0:1787833781.424681:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477616d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367220736:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833781.424704:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477616d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367220736:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 23us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833781.424710:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00080000:1.0:1787833781.424875:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833781.425333:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367220608 00000100:00100000:3.0:1787833781.425377:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367220608 00000100:00100000:3.0:1787833781.425420:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 244 00000100:00100000:3.0:1787833781.425429:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2345:x1874679367220608:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833781.425469:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2345:x1874679367220608:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 42us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833781.425494:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 244 00010000:00010000:1.0:1787833781.564762:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833781.824943:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833781.824975:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375645696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833781.825073:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833781.825163:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375645696 00000100:00100000:1.0:1787833781.825173:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375645696 00000100:00100000:1.0:1787833781.825245:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787833781.825258:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375645696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833781.825306:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833781.825391:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375645696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833781.825399:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787833781.825429:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787833781.825463:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64776152c0 x1874679375645696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833781.825487:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375645696:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787833782.469956:0:11444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:29:41 (1787833781) === 00010000:00010000:0.0:1787833782.602406:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833782.656503:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833782.657825:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367220992 00000100:00100000:2.0:1787833782.657837:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367220992 00000100:00100000:2.0:1787833782.658007:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:2.0:1787833782.658018:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367220992:12345-192.168.202.15@tcp:41:mkdir.0 00000004:00000024:2.0:1787833782.658210:0:5815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787833782.658417:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367220992:12345-192.168.202.15@tcp:41:mkdir.0 Request processed in 400us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833782.658425:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787833782.660571:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833782.665197:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367221120 00000100:00100000:1.0:1787833782.665461:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367221120 00000100:00100000:1.0:1787833782.665575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787833782.665587:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:320cb14b-678a-483a-8914-ee446104f369+6:9670:x1874679367221120:12345-192.168.202.15@tcp:700:mkdir.0 00000100:00100000:1.0:1787833782.665698:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:320cb14b-678a-483a-8914-ee446104f369+6:9670:x1874679367221120:12345-192.168.202.15@tcp:700:mkdir.0 Request processed in 113us (5133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833782.665706:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:0.0:1787833782.676928:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833782.677015:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367221376 00000100:00100000:3.0:1787833782.677027:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367221376 00000100:00100000:3.0:1787833782.677088:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:3.0:1787833782.677099:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:9670:x1874679367221376:12345-192.168.202.15@tcp:36:mkdir.0 00010000:00010000:3.0:1787833782.677155:0:7195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833782.677233:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e774cdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39b6 expref: 6 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.677256:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279200) 00010000:00010000:3.0:1787833782.677267:0:7195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833782.677638:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.677653:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.677663:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.677692:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.677700:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.677706:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833782.678934:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787833782.678949:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.678957:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.678965:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.678971:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833782.678975:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.678983:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.678997:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b645a7d3a00) 00010000:00010000:3.0:1787833782.679005:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833782.679010:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.679016:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774dfc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833782.679032:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0f5b257 reply state 00000000ed13391b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833782.679041:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833782.679142:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+7:9670:x1874679367221376:12345-192.168.202.15@tcp:36:mkdir.0 Request processed in 2043us (2223us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787833782.679161:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00010000:00010000:1.0:1787833782.680821:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.680837:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.680912:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.680920:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833782.680924:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.680931:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.680949:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b645a7d3e00) 00010000:00010000:1.0:1787833782.680952:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833782.680956:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.680962:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774e03 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833782.692519:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833782.692607:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367221504 00000100:00100000:1.0:1787833782.692618:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367221504 00000100:00100000:1.0:1787833782.692688:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787833782.692700:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:9671:x1874679367221504:12345-192.168.202.15@tcp:101:chmod.0 00010000:00010000:1.0:1787833782.692734:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833782.692759:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a3b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.692823:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e774e11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.692836:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e774e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.692861:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e774e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833782.692932:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787833782.692937:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833782.692982:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e774e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.693011:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a3b expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.693030:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e774e11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a3b expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.693039:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01600) 00010000:00010000:1.0:1787833782.693042:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833782.693047:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199200, rc 0) 00000100:00100000:1.0:1787833782.693107:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+7:9671:x1874679367221504:12345-192.168.202.15@tcp:101:chmod.0 Request processed in 410us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833782.693115:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787833782.696299:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833782.696407:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367221760 00000100:00100000:3.0:1787833782.696417:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367221760 00000100:00100000:3.0:1787833782.696477:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787833782.696488:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+7:9671:x1874679367221760:12345-192.168.202.15@tcp:36:chmod.0 00010000:00010000:3.0:1787833782.696539:0:7195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833782.696566:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e774e11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a3b expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.696586:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01600) 00010000:00010000:3.0:1787833782.696597:0:7195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833782.696620:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.696633:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.696643:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833782.696980:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3790515 reply state 000000003d6128cd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833782.696995:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787833782.697009:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787833782.697101:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+8:9671:x1874679367221760:12345-192.168.202.15@tcp:36:chmod.0 Request processed in 613us (821us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787833782.697108:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00010000:00010000:2.0:1787833782.698755:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.698773:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.698780:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.698786:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833782.698791:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.698799:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.698815:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b645a7d3a00) 00010000:00010000:2.0:1787833782.698818:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787833782.698823:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.698827:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774e18 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833782.728653:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833782.729293:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367221888 00000100:00100000:1.0:1787833782.729303:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367221888 00000100:00100000:1.0:1787833782.729403:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:1.0:1787833782.729414:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+7:9672:x1874679367221888:12345-192.168.202.15@tcp:101:chown.0 00010000:00010000:1.0:1787833782.729441:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833782.729465:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a42 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.729536:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e774e26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.729551:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e774e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.729563:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e774e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833782.729620:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787833782.729624:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833782.729666:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e774e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.729694:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a42 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.729712:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e774e26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a42 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.729723:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01900) 00010000:00010000:1.0:1787833782.729726:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833782.729746:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199000, rc 0) 00000100:00100000:1.0:1787833782.729817:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+8:9672:x1874679367221888:12345-192.168.202.15@tcp:101:chown.0 Request processed in 405us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833782.729825:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:3.0:1787833782.734190:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833782.735583:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367222016 00000100:00100000:0.0:1787833782.735595:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367222016 00000100:00100000:0.0:1787833782.735672:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787833782.735683:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+8:9672:x1874679367222016:12345-192.168.202.15@tcp:101:chown.0 00010000:00010000:0.0:1787833782.735704:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833782.735727:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a49 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.735791:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.735806:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.735834:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.735850:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.735857:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.735863:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.735971:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774e42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.735979:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.735986:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833782.736023:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787833782.736027:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833782.736052:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736063:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736069:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736085:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736092:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c4c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833782.736095:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736102:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736114:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01900) 00010000:00010000:0.0:1787833782.736117:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833782.736122:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736129:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736142:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736149:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736154:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736160:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c5400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833782.736163:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736179:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736187:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b646021dd00) 00010000:00010000:0.0:1787833782.736190:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833782.736192:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736198:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.736229:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a49 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.737138:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a49 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.737147:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:0.0:1787833782.737149:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833782.737152:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b64821c5200, rc 0) 00000100:00100000:0.0:1787833782.737231:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+9:9672:x1874679367222016:12345-192.168.202.15@tcp:101:chown.0 Request processed in 1550us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833782.737251:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787833782.741600:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833782.741722:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367222272 00000100:00100000:1.0:1787833782.741732:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367222272 00000100:00100000:1.0:1787833782.741789:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:1.0:1787833782.741797:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+9:9672:x1874679367222272:12345-192.168.202.15@tcp:36:chown.0 00010000:00010000:1.0:1787833782.741842:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833782.741867:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774e42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a49 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.741893:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:1.0:1787833782.741905:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833782.741928:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.741938:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.741945:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833782.782732:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787833782.782928:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038d18e02 reply state 00000000631cd434 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833782.782944:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787833782.783096:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787833782.783726:0:5817:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787833782.783751:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+7:9672:x1874679367222272:12345-192.168.202.15@tcp:36:chown.0 Request processed in 41950us (42155us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787833782.783769:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00010000:00010000:0.0:1787833782.783906:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.783917:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.783932:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.783939:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833782.783943:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.783952:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.783977:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6451e01600) 00010000:00010000:0.0:1787833782.783981:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787833782.783985:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.783992:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833782.825556:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833782.825656:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367222400 00000100:00100000:3.0:1787833782.825666:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367222400 00000100:00100000:3.0:1787833782.825725:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:3.0:1787833782.825736:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:9673:x1874679367222400:12345-192.168.202.15@tcp:101:touch.500 00010000:00010000:3.0:1787833782.825761:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833782.825785:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a50 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787833782.830298:0:7195:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4458us 00010000:00010000:0.0:1787833782.839999:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840022:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840034:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840049:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840063:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840069:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840567:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840577:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840584:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833782.840662:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787833782.840666:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833782.840761:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840775:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840782:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840788:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840794:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c4a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833782.840798:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840812:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840824:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01900) 00010000:00010000:0.0:1787833782.840827:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833782.840832:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.840838:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841587:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841594:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841601:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841607:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c5400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833782.841610:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841617:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841626:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b646021dd00) 00010000:00010000:0.0:1787833782.841629:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833782.841632:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841648:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774e5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841693:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a50 expref: 8 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841708:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a50 expref: 7 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.841715:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021d700) 00010000:00010000:0.0:1787833782.841717:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787833782.841719:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b64821c4c00, rc 0) 00000100:00100000:0.0:1787833782.841795:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+7:9673:x1874679367222400:12345-192.168.202.15@tcp:101:touch.500 Request processed in 16060us (16248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833782.841805:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787833782.846695:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833782.846811:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367222656 00000100:00100000:1.0:1787833782.846821:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367222656 00000100:00100000:1.0:1787833782.846894:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:1.0:1787833782.846906:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+7:9673:x1874679367222656:12345-192.168.202.15@tcp:101:touch.500 00010000:00010000:1.0:1787833782.846928:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833782.846949:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e774e6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a57 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.847267:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.847520:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.847534:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.847550:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.847557:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.847563:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787833782.848669:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787833782.849705:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e774e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.849730:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e774e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.849742:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e774e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.849781:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.849789:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.849796:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.849802:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833782.849806:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.849814:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.849826:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021d700) 00010000:00010000:1.0:1787833782.849829:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833782.849834:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.850075:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774e73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833782.850092:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043f24355 reply state 00000000b7ba1cf4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833782.850107:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787833782.850147:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e774e6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a57 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.850162:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e774e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a57 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.850170:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6451e01800) 00010000:00010000:1.0:1787833782.850172:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833782.850175:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199600, rc 0) 00000100:00100000:1.0:1787833782.850413:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+10:9673:x1874679367222656:12345-192.168.202.15@tcp:101:touch.500 Request processed in 3508us (3726us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787833782.850422:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00010000:00010000:0.0:1787833782.855015:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.855033:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833782.855787:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833782.855862:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367222912 00000100:00100000:2.0:1787833782.855872:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367222912 00000100:00100000:2.0:1787833782.855937:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787833782.855956:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+10:9673:x1874679367222912:12345-192.168.202.15@tcp:36:touch.500 00010000:00010000:2.0:1787833782.856011:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833782.856034:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e774e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a57 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.856048:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6451e01800) 00010000:00010000:2.0:1787833782.856059:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833782.856101:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.856114:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.856124:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833782.856258:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a3b23dc reply state 0000000031739308 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833782.856267:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833782.856402:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+11:9673:x1874679367222912:12345-192.168.202.15@tcp:36:touch.500 Request processed in 447us (618us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787833782.856409:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00010000:00010000:0.0:1787833782.857314:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.857322:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833782.857326:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.857525:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.857538:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff9b6451e01200) 00010000:00010000:0.0:1787833782.857541:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833782.857545:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.857552:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e774e7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.858589:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.858600:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.858606:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.858611:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833782.858615:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.858620:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.858640:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6474279900) 00010000:00010000:1.0:1787833782.858643:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833782.858647:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.858652:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774e8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833782.860165:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833782.860231:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367223040 00000100:00100000:0.0:1787833782.860241:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367223040 00000100:00100000:0.0:1787833782.860312:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:0.0:1787833782.860323:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477615e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+9:9673:x1874679367223040:12345-192.168.202.15@tcp:101:touch.500 00010000:00010000:0.0:1787833782.860378:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833782.860397:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a5e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.860455:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a5e expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.860469:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a5e expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.860487:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b646021dd00) 00010000:00010000:0.0:1787833782.860490:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833782.860501:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b64821c4a00, rc 0) 00000100:00100000:0.0:1787833782.860563:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477615e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+10:9673:x1874679367223040:12345-192.168.202.15@tcp:101:touch.500 Request processed in 242us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833782.860570:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:2.0:1787833782.863800:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833782.863910:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367223168 00000100:00100000:3.0:1787833782.863920:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367223168 00000100:00100000:3.0:1787833782.863973:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:3.0:1787833782.863981:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1874679367223168:12345-192.168.202.15@tcp:8:touch.500 00010000:00080000:3.0:1787833782.864015:0:6660:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1787833782.864046:0:6660:0:(genops.c:1385:class_connect()) connect: client 320cb14b-678a-483a-8914-ee446104f369, cookie 0x2bdb54ee5e774e9d 00002000:00100000:3.0:1787833782.864059:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 320cb14b-678a-483a-8914-ee446104f369/ffff9b646e1ca800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787833782.864070:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1787833782.864280:0:6660:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787833782.864308:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9b646e1c8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833782.864407:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+6:2343:x1874679367223168:12345-192.168.202.15@tcp:8:touch.500 Request processed in 425us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833782.864416:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787833782.867309:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833782.867460:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367223296 00000100:00100000:3.0:1787833782.867471:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367223296 00000100:00100000:3.0:1787833782.867550:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787833782.867560:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+6:0:x1874679367223296:12345-192.168.202.15@tcp:2:touch.500 00000100:00080000:1.0:1787833782.867957:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787833782.912708:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1787833782.912726:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000100:00100000:0.0:1787833782.913023:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+5:0:x1874679367223296:12345-192.168.202.15@tcp:2:touch.500 Request processed in 45458us (45716us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787833782.913036:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:1.0:1787833782.915971:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833782.916065:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367223552 00000100:00100000:0.0:1787833782.916077:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367223552 00000100:00100000:0.0:1787833782.916141:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:0.0:1787833782.916151:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+10:9673:x1874679367223552:12345-192.168.202.15@tcp:35:touch.500 00000100:00100000:0.0:1787833782.916631:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+11:9673:x1874679367223552:12345-192.168.202.15@tcp:35:touch.500 Request processed in 479us (668us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787833782.916640:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:2.0:1787833782.929144:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833782.929569:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367223680 00000100:00100000:0.0:1787833782.929579:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367223680 00000100:00100000:0.0:1787833782.929636:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787833782.929645:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+11:9674:x1874679367223680:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:0.0:1787833782.929670:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833782.929690:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e774ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a65 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.929760:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774eab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.929774:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.929804:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833782.929864:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787833782.929869:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833782.929925:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774eab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.929951:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e774ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a65 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.929969:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774eab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a65 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.929977:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021d700) 00010000:00010000:0.0:1787833782.929979:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833782.929983:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b64821c5400, rc 0) 00000100:00100000:0.0:1787833782.930051:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+12:9674:x1874679367223680:12345-192.168.202.15@tcp:101:rm.0 Request processed in 407us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833782.930059:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787833782.933376:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833782.933563:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367223936 00000100:00100000:2.0:1787833782.933573:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367223936 00000100:00100000:2.0:1787833782.933636:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787833782.933647:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+12:9674:x1874679367223936:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:2.0:1787833782.933684:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833782.933706:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e774eb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a6c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833782.933819:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787833782.933996:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e774eb2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a6c expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.934010:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01900) 00010000:00010000:2.0:1787833782.934014:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833782.934019:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e774eb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a6c expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.934032:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83800, rc 0) 00000100:00100000:2.0:1787833782.934609:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+13:9674:x1874679367223936:12345-192.168.202.15@tcp:101:rm.0 Request processed in 962us (1271us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787833782.934617:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787833782.940431:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833782.940780:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367224064 00000100:00100000:0.0:1787833782.940791:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367224064 00000100:00100000:0.0:1787833782.940855:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:0.0:1787833782.940865:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+13:9674:x1874679367224064:12345-192.168.202.15@tcp:37:rm.0 00000100:00100000:3.0:1787833782.945093:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+13:9674:x1874679367224064:12345-192.168.202.15@tcp:37:rm.0 Request processed in 4218us (4661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833782.945109:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:1.0:1787833782.951054:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833782.951159:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367224320 00000100:00100000:0.0:1787833782.951170:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367224320 00000100:00100000:0.0:1787833782.951240:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787833782.951252:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+13:9674:x1874679367224320:12345-192.168.202.15@tcp:35:rm.0 00000100:00100000:0.0:1787833782.952063:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f15450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+14:9674:x1874679367224320:12345-192.168.202.15@tcp:35:rm.0 Request processed in 809us (1015us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787833782.952073:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:1.0:1787833782.956198:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833782.956420:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367224576 00000100:00100000:0.0:1787833782.956430:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367224576 00000100:00100000:0.0:1787833782.956596:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787833782.956606:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477615a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+14:9674:x1874679367224576:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:0.0:1787833782.956633:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833782.956655:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e774ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a73 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.956775:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774ec7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.956790:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.956802:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833782.956814:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787833782.957051:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e774ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a73 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.957069:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a73 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.957089:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021d700) 00010000:00010000:0.0:1787833782.957091:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787833782.957095:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b64821c5200, rc 0) 00000100:00100000:0.0:1787833782.957162:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477615a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+16:9674:x1874679367224576:12345-192.168.202.15@tcp:101:rm.0 Request processed in 557us (973us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787833782.957169:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:2.0:1787833782.960536:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833782.960689:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367224704 00000100:00100000:0.0:1787833782.960699:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367224704 00000100:00100000:0.0:1787833782.960760:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:0.0:1787833782.960770:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+16:9674:x1874679367224704:12345-192.168.202.15@tcp:41:rm.0 00000004:00000024:0.0:1787833782.960834:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787833782.960928:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+16:9674:x1874679367224704:12345-192.168.202.15@tcp:41:rm.0 Request processed in 159us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833782.960936:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:1.0:1787833782.963531:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833782.963578:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367224832 00000100:00100000:3.0:1787833782.963586:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367224832 00000100:00100000:3.0:1787833782.963633:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:3.0:1787833782.963644:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+16:9674:x1874679367224832:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:3.0:1787833782.963665:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833782.963683:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e774ed5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a7a expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963734:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963745:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963753:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963763:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963767:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963771:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963870:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963902:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963909:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833782.963934:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787833782.963938:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833782.963951:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963960:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963965:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963969:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963973:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963977:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833782.963979:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963984:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.963993:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021d700) 00010000:00010000:3.0:1787833782.963995:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833782.964002:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964007:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774edc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964015:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964019:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964022:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964025:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ce00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833782.964027:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964030:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964034:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff9b645a7d3900) 00010000:00010000:3.0:1787833782.964035:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833782.964036:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964039:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ce00/0x2bdb54ee5e774ee3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964059:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e774ed5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a7a expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964075:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a7a expref: 17 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833782.964079:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b646021dd00) 00010000:00010000:3.0:1787833782.964081:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833782.964082:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c000, rc 0) 00000100:00100000:3.0:1787833782.964670:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+17:9674:x1874679367224832:12345-192.168.202.15@tcp:101:rm.0 Request processed in 1023us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833782.964679:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:0.0:1787833782.967602:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833782.967658:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367225088 00000100:00100000:1.0:1787833782.967666:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367225088 00000100:00100000:1.0:1787833782.967729:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:1.0:1787833782.967739:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a409a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+17:9674:x1874679367225088:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:1.0:1787833782.967797:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787833782.967825:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e774eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a7a expref: 17 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.967863:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e774e96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a5e expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.967876:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b646021dd00) 00010000:00010000:1.0:1787833782.967941:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e774eab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a65 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.967953:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021d700) 00010000:00010000:1.0:1787833782.967956:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833782.967976:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.967990:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.968000:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.968014:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.968021:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.968028:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.968174:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.968182:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.968189:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787833782.969604:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787833782.969625:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 261725284276ns, next at 262725281629ns, rc = 0 00010000:00010000:1.0:1787833782.969692:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969704:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969711:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969717:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969721:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969724:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969770:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833782.969790:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969794:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969797:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969801:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833782.969804:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969816:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969824:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:1.0:1787833782.969826:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787833782.969829:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969833:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e774eff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969853:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969857:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969861:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969864:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833782.969866:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969869:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969873:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021d700) 00010000:00010000:1.0:1787833782.969874:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833782.969876:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833782.969897:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e774ef1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833782.969912:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007990d29c reply state 0000000010255a3c transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833782.969921:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787833782.969921:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833782.969927:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.969933:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833782.969936:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.969941:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.969949:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:0.0:1787833782.969957:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787833782.969961:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.969965:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.969979:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833782.969981:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833782.969983:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833782.970013:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a409a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+16:9674:x1874679367225088:12345-192.168.202.15@tcp:36:rm.0 Request processed in 2271us (2412us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787833782.970022:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00010000:00010000:0.0:1787833782.972189:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.972536:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.972545:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.972551:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833782.972555:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.972563:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.972579:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff9b6451e01b00) 00010000:00010000:0.0:1787833782.972582:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833782.972587:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.972593:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199e00/0x2bdb54ee5e774ef8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833782.972868:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833782.972945:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367225344 00000100:00100000:3.0:1787833782.972954:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367225344 00000100:00100000:3.0:1787833782.973000:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787833782.973009:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+15:9674:x1874679367225344:12345-192.168.202.15@tcp:35:rm.0 00000100:00100000:3.0:1787833782.973542:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+16:9674:x1874679367225344:12345-192.168.202.15@tcp:35:rm.0 Request processed in 532us (675us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787833782.973548:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787833782.975646:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833782.975809:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367225600 00000100:00100000:0.0:1787833782.975816:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367225600 00000100:00100000:0.0:1787833782.975942:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:0.0:1787833782.975952:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+16:9674:x1874679367225600:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:0.0:1787833782.976010:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787833782.976037:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e774ec7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a73 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976059:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e774e65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a50 expref: 15 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976070:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021d700) 00010000:00010000:0.0:1787833782.976085:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e774e26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a42 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976094:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01900) 00010000:00010000:0.0:1787833782.976100:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833782.976122:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976135:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976144:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976170:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976190:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976198:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976603:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976613:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.976620:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833782.978437:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787833782.978508:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978515:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978520:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978523:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833782.978526:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978532:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978550:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b646021de00) 00010000:00010000:0.0:1787833782.978552:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787833782.978555:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978559:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e774f1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978578:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978581:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978584:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978587:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833782.978589:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978592:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978597:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d400) 00010000:00010000:0.0:1787833782.978600:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833782.978602:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833782.978607:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e774f0d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833782.978630:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9c00016 reply state 000000004b20bf48 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833782.978639:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833782.980654:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+15:9674:x1874679367225600:12345-192.168.202.15@tcp:36:rm.0 Request processed in 4691us (5001us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787833782.980667:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00010000:00010000:2.0:1787833782.981136:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.981147:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.981154:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.981179:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833782.981184:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.981191:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.981207:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b646021dc00) 00010000:00010000:2.0:1787833782.981209:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833782.981214:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833782.981220:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e774f14 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833783.612621:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833784.380729:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375646080:0@lo:400:kworker.0 00000100:00100000:0.0:1787833784.380804:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833784.380884:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833784.380891:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375646208:0@lo:400:kworker.0 00000100:00100000:0.0:1787833784.380919:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833784.380957:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375646080 00000100:00100000:0.0:1787833784.380964:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375646080 00000100:00100000:0.0:1787833784.381040:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787833784.381050:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6449185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375646080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833784.381102:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6449185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375646080:12345-0@lo:400:kworker.0 Request processed in 53us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833784.381109:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787833784.381131:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375646208 00000100:00100000:0.0:1787833784.381135:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375646208 00000100:00100000:0.0:1787833784.381163:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787833784.381170:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462315e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375646208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833784.381202:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462315e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375646208:12345-0@lo:400:kworker.0 Request processed in 33us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833784.381209:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787833784.381241:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833784.381245:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787833784.381274:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f9f8000 x1874679375646208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833784.381287:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375646208:0@lo:400:kworker.0 00000100:00100000:0.0:1787833784.381299:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375646080:0@lo:400:kworker.0 00000100:00100000:2.0:1787833784.381449:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375645824:0@lo:400:kworker.0 00000100:00100000:2.0:1787833784.381485:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833784.381520:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375646336:0@lo:400:kworker.0 00000100:00100000:2.0:1787833784.381543:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833784.381561:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787833784.381567:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375645952:0@lo:400:kworker.0 00000100:00100000:1.0:1787833784.381567:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375646336 00000100:00100000:1.0:1787833784.381570:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375646336 00000100:00100000:1.0:1787833784.381597:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787833784.381601:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833784.381604:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375646336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833784.381619:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375646464:0@lo:400:kworker.0 00000100:00100000:1.0:1787833784.381636:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375646336:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833784.381640:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833784.381642:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787833784.381652:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375645952 00000100:00100000:1.0:1787833784.381655:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375645952 00000100:00100000:2.0:1787833784.381661:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375646336:0@lo:400:kworker.0 00000100:00100000:1.0:1787833784.381667:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787833784.381671:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375645952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833784.381687:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375646464 00000100:00100000:2.0:1787833784.381696:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375646464 00000100:00100000:1.0:1787833784.381701:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375645952:12345-0@lo:400:kworker.0 Request processed in 29us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833784.381706:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787833784.381720:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787833784.381725:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375646464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833784.381756:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375646464:12345-0@lo:400:kworker.0 Request processed in 31us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833784.381762:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787833784.381788:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375645952:0@lo:400:kworker.0 00010000:00080000:2.0:1787833784.381797:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f9f8b40 x1874679375646464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833784.381806:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375646464:0@lo:400:kworker.0 00000100:00100000:0.0:1787833784.381952:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375645824 00000100:00100000:0.0:1787833784.381957:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375645824 00000100:00100000:0.0:1787833784.382005:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787833784.382012:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375645824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833784.382223:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375645824:12345-0@lo:400:kworker.0 Request processed in 211us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833784.382230:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1787833784.382264:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833784.382268:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833784.382328:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375645824:0@lo:400:kworker.0 00010000:00010000:0.0:1787833784.637723:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833784.892581:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375646592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833784.892657:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833784.892893:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375646592 00000100:00100000:2.0:1787833784.892901:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375646592 00000100:00100000:2.0:1787833784.892953:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787833784.892962:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375646592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833784.892995:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833784.893046:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375646592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833784.893053:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787833784.893091:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b646e1a0f00 x1874679375646592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833784.893109:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375646592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787833785.660677:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833786.548949:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833786.549049:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833786.551515:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833786.555425:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367225728 00000100:00100000:0.0:1787833786.555441:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367225728 00000100:00100000:0.0:1787833786.555508:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 246 00000100:00100000:0.0:1787833786.555519:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367225728:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833786.555600:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367225728:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 83us (6551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833786.555630:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 246 00000100:00100000:3.0:1787833786.558898:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833786.561002:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367225856 00000100:00100000:1.0:1787833786.561017:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367225856 00000100:00100000:1.0:1787833786.561098:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367226112 00000100:00100000:1.0:1787833786.561108:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367226112 00000100:00100000:1.0:1787833786.561142:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:1.0:1787833786.561152:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+14:2346:x1874679367225856:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833786.561239:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+14:2346:x1874679367225856:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 88us (12300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833786.561262:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:1.0:1787833786.561280:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:1.0:1787833786.561287:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367226112:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833786.561315:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367226112:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (9808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833786.561321:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00080000:1.0:1787833786.561363:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833786.564633:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367225984 00000100:00100000:2.0:1787833786.564647:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367225984 00000100:00080000:0.0:1787833786.572764:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833786.579626:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:2.0:1787833786.579653:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367225984:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833786.579961:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367225984:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 314us (21071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833786.579970:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00010000:00010000:3.0:1787833786.686533:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787833786.695072:0:11595:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1787833786.940870:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1787833786.940917:0:6770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 265696576142ns, next at 266696573765ns, rc = 0 00000100:00100000:0.0:1787833786.943538:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477616940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375646720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833786.943619:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833786.949771:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375646720 00000100:00100000:2.0:1787833786.949788:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375646720 00000100:00100000:2.0:1787833786.949879:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787833786.949891:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375646720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833786.949937:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787833786.950083:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833786.950597:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375646720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 706us (6975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833786.950605:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787833786.950691:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6477616940 x1874679375646720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833786.950717:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477616940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375646720:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1787833787.595257:0:11643:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc8f14eb0 20000000:00000080:1.0:1787833787.595276:0:11643:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6479df1000 uarg=0000000000000000 20000000:01000000:1.0:1787833787.595312:0:11643:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787833787.595319:0:11643:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787833787.595324:0:11643:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787833787.598764:0:11644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787833787.600431:0:11643:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787833787.609157:0:11643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787833787.609216:0:11643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787833787.609279:0:11643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787833787.609298:0:11643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787833787.609318:0:11643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.609415:0:11643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a2d expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.609436:0:11643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a34 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.609444:0:11643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774dd2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.609451:0:11643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774de0 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.609459:0:11643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774dee expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.609466:0:11643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.609508:0:11643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774dee expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.609523:0:11643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774dee expref: 18 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833787.609540:0:11643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64776170c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375646848:0@lo:104: 00000100:00100000:1.0:1787833787.609613:0:11643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833787.609666:0:11643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774de0 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833787.609767:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375646848 00000100:00100000:2.0:1787833787.609775:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375646848 00000100:00100000:2.0:1787833787.609854:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787833787.609864:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477615680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:11643:x1874679375646848:12345-0@lo:104: 00010000:00010000:2.0:1787833787.609876:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.609928:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833787.609935:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477615680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:11643:x1874679375646848:12345-0@lo:104: Request processed in 73us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833787.609942:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787833787.609966:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833787.609971:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.609991:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198600 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:2.0:1787833787.609994:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.610001:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833787.610008:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833787.610013:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787833787.610045:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.610051:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833787.610071:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.610078:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462198600/0x2bdb54ee5e774dee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774df5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.610089:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833787.610091:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833787.610093:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833787.610105:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375647104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833787.610133:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833787.610169:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375647104 00000100:00100000:2.0:1787833787.610173:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375647104 00010000:00010000:2.0:1787833787.610192:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774dee expref: 19 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833787.610221:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787833787.610227:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375647104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833787.610238:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833787.610243:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774dee expref: 19 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.610770:0:11643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774de0 expref: 19 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833787.610804:0:11643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375646976:0@lo:104: 00000100:00100000:1.0:1787833787.610870:0:11643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833787.614028:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774dee expref: 19 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.614058:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833787.614144:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375647104:12345-0@lo:103:ldlm_bl.0 Request processed in 3916us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833787.614155:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787833787.614226:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375647104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833787.614393:0:11643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e774dd2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.614407:0:11643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e774dd2 expref: 18 pid: 5810 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833787.614423:0:11643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477616940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375647232:0@lo:104: 00010000:00010000:1.0:1787833787.614489:0:11643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a34 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.614499:0:11643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a34 expref: 12 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833787.614508:0:11643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477616580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375647360:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833787.614565:0:11643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a2d expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.614574:0:11643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a2d expref: 12 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833787.614583:0:11643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477617c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375647488:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833787.614605:0:11643:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64468b5cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787833787.614619:0:11643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e774df5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774dee expref: 18 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833787.614655:0:11643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64776170c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375646848:0@lo:104: 00000100:00100000:2.0:1787833787.615158:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787833787.615182:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833787.615205:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375646976 00000100:00100000:2.0:1787833787.615211:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375646976 00000100:00100000:2.0:1787833787.615245:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375647232 00000100:00100000:2.0:1787833787.615248:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375647232 00000100:00100000:2.0:1787833787.615262:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787833787.615269:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:11643:x1874679375646976:12345-0@lo:104: 00010000:00010000:2.0:1787833787.615283:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615371:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833787.615377:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+4:11643:x1874679375646976:12345-0@lo:104: Request processed in 109us (4507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833787.615390:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787833787.615428:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787833787.615434:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:11643:x1874679375647232:12345-0@lo:104: 00010000:00010000:2.0:1787833787.615442:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615474:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787833787.615479:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+3:11643:x1874679375647232:12345-0@lo:104: Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833787.615484:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787833787.615502:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787833787.615508:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615514:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c600 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:2.0:1787833787.615518:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615527:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833787.615534:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833787.615539:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787833787.615567:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615574:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833787.615599:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615606:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e774de0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774de7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615616:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833787.615619:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615624:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198200 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:2.0:1787833787.615627:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615633:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833787.615639:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833787.615644:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787833787.615656:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.615660:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787833787.616027:0:11643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375646976:0@lo:104: 00000100:00100000:1.0:1787833787.616037:0:11643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477616940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375647232:0@lo:104: 00010000:00010000:3.0:1787833787.616098:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833787.616128:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.616137:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e774dd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e774dd9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.616150:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833787.616157:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833787.616159:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833787.616170:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375647744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833787.616208:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833787.616262:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375647616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833787.616285:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833787.616451:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375647744 00000100:00100000:3.0:1787833787.616457:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375647744 00010000:00010000:3.0:1787833787.616486:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774dd2 expref: 18 pid: 5810 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833787.616547:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375647616 00000100:00100000:3.0:1787833787.616551:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375647616 00010000:00010000:3.0:1787833787.616564:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774de0 expref: 19 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833787.616577:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833787.616584:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375647744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833787.616595:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833787.616599:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774dd2 expref: 19 pid: 5810 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833787.616609:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774dd2 expref: 19 pid: 5810 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833787.616623:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2d400/0x2bdb54ee5e774dd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774dd2 expref: 19 pid: 5810 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833787.616635:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833787.616669:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3282:x1874679375647744:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833787.617525:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787833787.617548:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787833787.617558:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446008850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:3281:x1874679375647616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833787.617570:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833787.617577:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e774de0 expref: 17 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833787.617588:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e774de0 expref: 17 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833787.617608:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462198400/0x2bdb54ee5e774de7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e774de0 expref: 17 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833787.617619:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833787.617667:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446008850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3281:x1874679375647616:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833787.617682:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787833787.617741:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375647744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787833787.617816:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375647616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833787.621302:0:11643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477616580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375647360:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833787.621694:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833787.621902:0:11643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477617c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11643:1874679375647488:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833787.621936:0:11643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833787.622129:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367226240 00000100:00100000:3.0:1787833787.622137:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367226240 00010000:00010000:3.0:1787833787.622176:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a34 expref: 13 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833787.622214:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:3.0:1787833787.622223:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2345:x1874679367226240:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833787.622248:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833787.622254:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a34 expref: 13 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833787.622265:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a34 expref: 13 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833787.622285:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2c200/0x2bdb54ee5e774dcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a34 expref: 13 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833787.622299:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833787.622403:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:2345:x1874679367226240:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 180us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833787.622424:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:1.0:1787833787.625568:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833787.625658:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367226368 00000100:00100000:2.0:1787833787.625667:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367226368 00010000:00010000:2.0:1787833787.625716:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a2d expref: 12 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833787.625754:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:2.0:1787833787.625764:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477617c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:2344:x1874679367226368:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833787.625779:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833787.625784:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a2d expref: 12 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625796:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a2d expref: 12 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625825:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b64821c4200/0x2bdb54ee5e774dc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a2d expref: 12 pid: 5809 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625873:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625882:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625898:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625906:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625913:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625920:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625926:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199e00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833787.625930:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625938:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625964:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.625975:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833787.626039:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477617c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+11:2344:x1874679367226368:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 276us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833787.626055:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00010000:00010000:1.0:1787833787.626418:0:11643:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.626428:0:11643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833787.626435:0:11643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462199e00/0x2bdb54ee5e774f22 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833787.712348:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787833788.041936:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1787833788.041971:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:0.0:1787833788.041994:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787833788.042265:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833788.042287:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477616580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375647872:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787833788.042475:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833788.042596:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375647872 00000100:00100000:0.0:1787833788.042604:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375647872 00000100:00100000:0.0:1787833788.042664:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787833788.042674:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375647872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787833788.042710:0:6659:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787833788.042876:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a902db6, atime: 0x6a902db6, ctime: 0x6a902db6, blocks: 0x1 00010000:00010000:0.0:1787833788.042886:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833788.042900:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=266s v=(0 0) 00010000:00010000:0.0:1787833788.042904:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833788.042910:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833788.042939:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833788.042950:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833788.042958:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833788.042974:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1787833788.043402:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787833788.043766:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833788.043774:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.043787:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fa00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833788.043792:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787833788.043810:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6477616580/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787833788.043820:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477616580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375647872:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787833788.043938:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.043959:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.043966:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b5c0db/0x2bdb54ee5e774f29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.043986:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833788.043988:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833788.043990:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833788.044014:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1874679375647872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1003us (1200us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787833788.044024:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787833788.732994:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787833788.924457:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787833788.924466:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b647fa63000 from 7 10000000:01000000:1.0:1787833788.924471:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833788.924520:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833788.924531:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833788.924542:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833788.924567:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477616940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833788.924663:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833788.924726:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64468b5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833788.926326:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375648000 00000100:00100000:0.0:1787833788.926362:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375648000 00000100:00100000:0.0:1787833788.926428:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787833788.926437:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:5812:x1874679375648000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833788.926453:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833788.926471:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647751fa00/0x2bdb54ee5e774f37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774f30 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833788.926496:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647751fa00/0x2bdb54ee5e774f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774f30 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833788.926506:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647751fa00/0x2bdb54ee5e774f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774f30 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833788.926531:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751fa00, rc 0) 00000100:00100000:0.0:1787833788.926606:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375648000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833788.926613:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787833788.926823:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477616940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833788.926850:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833788.926860:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833788.926926:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833788.926960:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833788.926997:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fe2d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787833788.927382:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375648128 00000100:00100000:0.0:1787833788.927388:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375648128 00000100:00100000:0.0:1787833788.927427:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787833788.927434:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375648128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833788.927683:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375648128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833788.927691:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787833788.927801:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833788.927847:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833788.927886:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833788.927915:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fe2d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787833788.927977:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375648256 00000100:00100000:1.0:1787833788.927982:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375648256 00000100:00100000:1.0:1787833788.928002:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787833788.928009:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375648256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833788.928170:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375648256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833788.928177:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787833788.928428:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833788.928787:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11658:1874679375648384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833788.928825:0:11658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833788.928861:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fe2d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833788.928967:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375648384 00000100:00100000:1.0:1787833788.928972:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375648384 00000100:00100000:1.0:1787833788.928993:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787833788.929001:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:11658:x1874679375648384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833788.929154:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:11658:x1874679375648384:12345-0@lo:502:llog_process_th.0 Request processed in 153us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833788.929161:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787833788.929423:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11658:1874679375648384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787833788.929452:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833788.929461:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833788.929464:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787833788.929470:0:11658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b647fa63000 00000020:00000080:2.0:1787833788.929472:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787833788.929553:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11658:1874679375648512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833788.929597:0:11658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833788.929620:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fe2d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833788.929688:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375648512 00000100:00100000:3.0:1787833788.929693:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375648512 00000100:00100000:3.0:1787833788.929738:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787833788.929752:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:11658:x1874679375648512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833788.929885:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:11658:x1874679375648512:12345-0@lo:502:llog_process_th.0 Request processed in 134us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833788.929891:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787833788.930033:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11658:1874679375648512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787833788.930052:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833788.930057:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833788.930059:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787833788.930062:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787833788.930529:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787833788.930553:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833788.930563:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.930573:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833788.930584:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833788.930586:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b64773a1800 from 7 10000000:01000000:3.0:1787833788.930589:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833788.930612:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.930619:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.930627:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833788.930643:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.930679:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833788.930719:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451c56600 going to sleep for 11 seconds 00000100:00100000:2.0:1787833788.934525:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375648640 00000100:00100000:2.0:1787833788.934541:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375648640 00000100:00100000:2.0:1787833788.934605:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787833788.934616:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:5812:x1874679375648640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833788.934635:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833788.934653:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83800/0x2bdb54ee5e774f45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774f3e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833788.934680:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83800/0x2bdb54ee5e774f45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774f3e expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833788.934692:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83800/0x2bdb54ee5e774f45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774f3e expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833788.934712:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83800, rc 0) 00000100:00100000:2.0:1787833788.934795:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375648640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833788.934803:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787833788.934960:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833788.934979:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833788.934988:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833788.935056:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833788.935090:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833788.935129:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64468b5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787833788.935406:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375648768 00000100:00100000:2.0:1787833788.935411:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375648768 00000100:00100000:2.0:1787833788.935437:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787833788.935444:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375648768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833788.935676:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375648768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833788.935683:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787833788.935838:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833788.935872:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833788.935911:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833788.935940:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64468b5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833788.936543:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375648896 00000100:00100000:3.0:1787833788.936549:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375648896 00000100:00100000:3.0:1787833788.936600:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787833788.936608:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375648896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.936794:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375648896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833788.936802:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787833788.936858:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375648896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.937051:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11659:1874679375649024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833788.937087:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833788.937106:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375649024 00000100:00100000:3.0:1787833788.937110:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375649024 00000100:00100000:3.0:1787833788.937129:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787833788.937143:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64507c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:11659:x1874679375649024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833788.937268:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64507c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:11659:x1874679375649024:12345-0@lo:502:llog_process_th.0 Request processed in 133us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833788.937275:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787833788.937307:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833788.937319:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11659:1874679375649024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833788.937372:0:11659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833788.937381:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833788.937383:0:11659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787833788.937390:0:11659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b64773a1800 00000020:00000080:3.0:1787833788.937392:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787833788.937454:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11659:1874679375649152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833788.937486:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833788.937505:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375649152 00000100:00100000:3.0:1787833788.937514:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375649152 00000100:00100000:3.0:1787833788.937531:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787833788.937537:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:11659:x1874679375649152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833788.937644:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:11659:x1874679375649152:12345-0@lo:502:llog_process_th.0 Request processed in 107us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833788.937651:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787833788.937677:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833788.937688:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11659:1874679375649152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833788.937705:0:11659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833788.937709:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833788.937710:0:11659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787833788.937714:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787833788.937760:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787833788.937777:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833788.937786:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.937796:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833788.937806:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833788.937809:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6460630000 from 7 10000000:01000000:3.0:1787833788.937811:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833788.937845:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.937854:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.937864:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833788.937883:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375649280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.937908:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833788.937922:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833788.937933:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375649280 00000100:00100000:3.0:1787833788.937937:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375649280 00000100:00100000:3.0:1787833788.937953:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787833788.937958:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:5812:x1874679375649280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833788.937966:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833788.937976:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774f53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e774f4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.937995:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e774f4c expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.938006:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e774f4c expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.938015:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2ce00, rc 0) 00000100:00100000:3.0:1787833788.938042:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375649280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833788.938048:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787833788.938073:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375649280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833788.938083:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.938091:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833788.938128:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375649408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.938150:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833788.938163:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833788.938174:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375649408 00000100:00100000:3.0:1787833788.938177:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375649408 00000100:00100000:3.0:1787833788.938192:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787833788.938197:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375649408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.938419:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375649408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833788.938426:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787833788.938454:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375649408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.938477:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375649536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.938512:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833788.938526:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450f336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833788.938536:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375649536 00000100:00100000:3.0:1787833788.938539:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375649536 00000100:00100000:3.0:1787833788.938555:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787833788.938560:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375649536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.938671:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:5812:x1874679375649536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833788.938678:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787833788.938711:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b866019b-748d-45d1-b7c8-b21ed54e15f4:5812:1874679375649536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833788.938917:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11660:1874679375649664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833788.938955:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833788.938972:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375649664 00000100:00100000:3.0:1787833788.938975:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375649664 00000100:00100000:3.0:1787833788.938990:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787833788.938995:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:11660:x1874679375649664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833788.939099:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:11660:x1874679375649664:12345-0@lo:502:llog_process_th.0 Request processed in 103us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833788.939106:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787833788.939131:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6445cfa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833788.939141:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11660:1874679375649664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833788.939158:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833788.939166:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833788.939168:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787833788.939174:0:11660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6460630000 00000020:00000080:3.0:1787833788.939176:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787833788.939228:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11660:1874679375649792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833788.939258:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833788.939276:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375649792 00000100:00100000:3.0:1787833788.939279:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375649792 00000100:00100000:3.0:1787833788.939294:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787833788.939299:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:11660:x1874679375649792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833788.939417:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:11660:x1874679375649792:12345-0@lo:502:llog_process_th.0 Request processed in 117us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833788.939423:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787833788.939445:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647fd4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787833788.939456:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b866019b-748d-45d1-b7c8-b21ed54e15f4:11660:1874679375649792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833788.939477:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833788.939480:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833788.939482:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787833788.939485:0:11660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787833788.939523:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787833788.939537:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787833788.939544:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833788.939553:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787833788.969007:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787833789.500846:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375649920:0@lo:400:kworker.0 00000100:00100000:0.0:1787833789.500923:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375650048:0@lo:400:kworker.0 00000100:00100000:2.0:1787833789.500929:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.500962:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833789.501062:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375650176:0@lo:400:kworker.0 00000100:00100000:2.0:1787833789.501090:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.501096:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833789.501106:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375650432:0@lo:400:kworker.0 00000100:00100000:2.0:1787833789.501113:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833789.501121:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6342374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375650304:0@lo:400:kworker.0 00000100:00100000:0.0:1787833789.501140:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833789.501155:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833789.501178:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375650048 00000100:00100000:0.0:1787833789.501187:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375650048 00000100:00100000:2.0:1787833789.501193:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375650304 00000100:00100000:2.0:1787833789.501198:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375650304 00000100:00100000:0.0:1787833789.501235:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375650176 00000100:00100000:0.0:1787833789.501239:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375650176 00000100:00100000:2.0:1787833789.501244:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787833789.501255:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1874679375650304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833789.501267:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375650432 00000100:00100000:0.0:1787833789.501270:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375650432 00000100:00100000:0.0:1787833789.501289:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787833789.501298:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375650048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833789.501310:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1874679375650304:12345-0@lo:400:kworker.0 Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.501318:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787833789.501363:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375650048:12345-0@lo:400:kworker.0 Request processed in 45us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833789.501388:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787833789.504235:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833789.504267:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375650560:0@lo:400:kworker.0 00000100:00100000:3.0:1787833789.504334:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833789.504580:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375650560 00000100:00100000:3.0:1787833789.504588:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375650560 00000100:00100000:3.0:1787833789.504654:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787833789.504770:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375650560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833789.505034:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375650560:12345-0@lo:400:kworker.0 Request processed in 371us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.505042:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787833789.505088:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64623e83c0 x1874679375650560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833789.505103:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375650560:0@lo:400:kworker.0 00000100:00100000:3.0:1787833789.505159:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375650304:0@lo:400:kworker.0 00000100:00080000:3.0:1787833789.505195:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833789.505214:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833789.505440:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787833789.505458:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375650176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833789.505505:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375650176:12345-0@lo:400:kworker.0 Request processed in 50us (4414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.505512:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787833789.505543:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375650176:0@lo:400:kworker.0 00000100:00100000:2.0:1787833789.505564:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787833789.505571:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375650432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833789.505600:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375650432:12345-0@lo:400:kworker.0 Request processed in 30us (4461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.505606:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787833789.505640:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375650432:0@lo:400:kworker.0 00000100:00100000:2.0:1787833789.505652:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6342375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375650048:0@lo:400:kworker.0 00000100:00100000:1.0:1787833789.509315:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375649920 00000100:00100000:1.0:1787833789.509332:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375649920 00000100:00100000:1.0:1787833789.509417:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787833789.509428:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375649920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833789.509600:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375649920:12345-0@lo:400:kworker.0 Request processed in 173us (8673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.509608:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787833789.509739:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375649920:0@lo:400:kworker.0 00000100:00100000:0.0:1787833789.617445:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833789.618070:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367226496 00000100:00100000:2.0:1787833789.618081:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367226496 00000100:00100000:2.0:1787833789.618134:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 263 00000100:00100000:2.0:1787833789.618144:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+11:5589:x1874679367226496:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833789.618161:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833789.618178:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774f5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a81 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.618206:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774f5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a81 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.618220:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774f5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a81 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.618249:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c82000, rc 0) 00000100:00100000:2.0:1787833789.618311:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367226496:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 168us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.618318:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 263 00000100:00100000:3.0:1787833789.625131:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833789.625252:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367226624 00000100:00100000:2.0:1787833789.625262:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367226624 00000100:00100000:2.0:1787833789.625429:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 264 00000100:00100000:2.0:1787833789.625441:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367226624:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787833789.625723:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367226624:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 284us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.625732:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 264 00000100:00100000:0.0:1787833789.629140:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833789.629245:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367226752 00000100:00100000:3.0:1787833789.629256:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367226752 00000100:00100000:3.0:1787833789.629304:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 265 00000100:00100000:3.0:1787833789.629315:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367226752:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833789.629557:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367226752:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 243us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.629566:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 265 00000100:00100000:0.0:1787833789.633443:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833789.633535:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367226880 00000100:00100000:3.0:1787833789.633544:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367226880 00000100:00100000:3.0:1787833789.633589:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 266 00000100:00100000:3.0:1787833789.633600:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:9944:x1874679367226880:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787833789.633890:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:9944:x1874679367226880:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 282us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.633899:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 266 00000100:00100000:0.0:1787833789.639111:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833789.642744:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367227008 00000100:00100000:3.0:1787833789.642761:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367227008 00000100:00100000:3.0:1787833789.642845:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 267 00000100:00100000:3.0:1787833789.642855:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:9944:x1874679367227008:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787833789.643116:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+12:9944:x1874679367227008:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 261us (4014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.643125:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 267 00000100:00100000:0.0:1787833789.649589:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833789.649693:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367227136 00000100:00100000:2.0:1787833789.649702:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367227136 00000100:00100000:2.0:1787833789.649758:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 268 00000100:00100000:2.0:1787833789.649767:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:5589:x1874679367227136:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833789.649800:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833789.649820:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774f61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a88 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.649860:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a88 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.649870:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a88 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833789.649879:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83600, rc 0) 00000100:00100000:2.0:1787833789.649958:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367227136:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 192us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.649965:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 268 00000100:00100000:0.0:1787833789.652654:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833789.652748:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367227264 00000100:00100000:1.0:1787833789.652757:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367227264 00000100:00100000:1.0:1787833789.652832:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 269 00000100:00100000:1.0:1787833789.652842:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367227264:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833789.653093:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367227264:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 253us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.653099:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 269 00000100:00100000:0.0:1787833789.657683:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833789.666455:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367227392 00000100:00100000:3.0:1787833789.666470:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367227392 00000100:00100000:3.0:1787833789.666546:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 270 00000100:00100000:3.0:1787833789.666575:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367227392:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833789.666948:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:5589:x1874679367227392:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 375us (9274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833789.666956:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 270 00000100:00100000:0.0:1787833789.680481:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833789.681679:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367227520 00000100:00100000:2.0:1787833789.681693:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367227520 00000100:00100000:2.0:1787833789.681765:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 271 00000100:00100000:2.0:1787833789.681776:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:9947:x1874679367227520:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833789.682047:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:9947:x1874679367227520:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 271us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833789.682055:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 271 00000100:00100000:0.0:1787833789.690636:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833789.690731:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367227648 00000100:00100000:1.0:1787833789.690740:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367227648 00000100:00100000:1.0:1787833789.690798:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 272 00000100:00100000:1.0:1787833789.690807:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:9947:x1874679367227648:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787833789.691047:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:9947:x1874679367227648:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 240us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833789.691055:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 272 00010000:00010000:2.0:1787833789.756590:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833790.016410:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833790.016435:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375650688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833790.016513:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833790.016601:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375650688 00000100:00100000:3.0:1787833790.016609:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375650688 00000100:00100000:3.0:1787833790.016658:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787833790.016667:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375650688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833790.016703:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833790.016748:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375650688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833790.016756:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787833790.016798:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64623e83c0 x1874679375650688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833790.016817:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375650688:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787833790.019449:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787833790.780565:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833791.663454:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833791.663494:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833791.663587:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833791.663621:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833791.663652:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367228032 00000100:00100000:3.0:1787833791.663661:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367228032 00000100:00100000:3.0:1787833791.663726:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:3.0:1787833791.663751:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367228032:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833791.663841:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367228032:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833791.663849:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00080000:3.0:1787833791.663875:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833791.663885:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367227776 00000100:00100000:3.0:1787833791.663888:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367227776 00000100:00100000:3.0:1787833791.663914:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 273 00000100:00100000:3.0:1787833791.663921:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2346:x1874679367227776:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833791.663947:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2346:x1874679367227776:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833791.663953:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 273 00000100:00100000:2.0:1787833791.665269:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367227904 00000100:00100000:2.0:1787833791.665280:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367227904 00000100:00100000:2.0:1787833791.665359:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367228160 00000100:00100000:2.0:1787833791.665363:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367228160 00000100:00100000:2.0:1787833791.665395:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:2.0:1787833791.665404:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367227904:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833791.665420:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:0.0:1787833791.665433:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367228160:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833791.665478:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342374f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367227904:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 74us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833791.665486:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:0.0:1787833791.665579:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367228160:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 150us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833791.665587:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00080000:3.0:1787833791.666039:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787833791.807577:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833792.066134:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64776170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375650816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833792.066230:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833792.066444:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375650816 00000100:00100000:3.0:1787833792.066452:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375650816 00000100:00100000:3.0:1787833792.066529:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787833792.066539:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874679375650816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833792.066578:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833792.066650:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874679375650816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833792.066658:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787833792.066718:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64776170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375650816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787833792.067775:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787833792.828547:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787833793.163367:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1787833793.852853:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833794.620584:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375651328:0@lo:400:kworker.0 00000100:00100000:3.0:1787833794.620641:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833794.620706:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833794.620712:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375651200:0@lo:400:kworker.0 00000100:00100000:3.0:1787833794.620738:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833794.620768:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375651328 00000100:00100000:3.0:1787833794.620775:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375651328 00000100:00100000:3.0:1787833794.620842:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787833794.620852:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375651328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833794.620898:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375651328:12345-0@lo:400:kworker.0 Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833794.620903:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787833794.620921:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833794.620951:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787833794.620955:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6477616580, transno 4294967300 00000100:00100000:3.0:1787833794.620965:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375651328:0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.621668:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375651072:0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.621706:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833794.621737:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375651584:0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.621759:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833794.621810:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787833794.621816:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375650944:0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.621844:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833794.621867:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375651456:0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.621887:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833794.621906:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375651200 00000100:00100000:2.0:1787833794.621910:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375651200 00000100:00100000:2.0:1787833794.621932:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375651072 00000100:00100000:2.0:1787833794.621934:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375651072 00000100:00100000:2.0:1787833794.621941:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375651456 00000100:00100000:2.0:1787833794.621942:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375651456 00000100:00100000:2.0:1787833794.621952:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787833794.621956:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375651200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.621982:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375651200:12345-0@lo:400:kworker.0 Request processed in 25us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833794.621986:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787833794.621995:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787833794.621999:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375651072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.622016:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375651072:12345-0@lo:400:kworker.0 Request processed in 17us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833794.622019:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787833794.622026:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787833794.622029:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375651456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.622042:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375651456:12345-0@lo:400:kworker.0 Request processed in 13us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833794.622046:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787833794.622057:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375651584 00000100:00100000:2.0:1787833794.622064:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375651584 00000100:00100000:2.0:1787833794.622082:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787833794.622085:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375651584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.622105:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375651584:12345-0@lo:400:kworker.0 Request processed in 19us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833794.622108:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787833794.622119:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375650944 00000100:00100000:2.0:1787833794.622121:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375650944 00000100:00100000:2.0:1787833794.622134:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787833794.622137:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375650944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.622153:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375650944:12345-0@lo:400:kworker.0 Request processed in 15us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833794.622156:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787833794.622179:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375650944:0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.622187:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375651456:0@lo:400:kworker.0 00000100:00100000:2.0:1787833794.622202:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375651072:0@lo:400:kworker.0 00010000:00080000:2.0:1787833794.622210:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647766c3c0 x1874679375651584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833794.622217:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375651584:0@lo:400:kworker.0 00000100:00080000:3.0:1787833794.622494:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833794.622497:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833794.622512:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375651200:0@lo:400:kworker.0 00010000:00010000:2.0:1787833794.876994:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833795.132817:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833795.132842:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375651712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833795.132915:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833795.133215:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375651712 00000100:00100000:1.0:1787833795.133225:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375651712 00000100:00100000:1.0:1787833795.133274:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787833795.133283:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375651712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833795.133316:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833795.133397:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375651712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833795.133405:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787833795.133627:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b646e1a3c00 x1874679375651712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833795.133646:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375651712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787833795.900819:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833796.791679:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833796.791726:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833796.791771:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833796.791807:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833796.791896:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367228288 00000100:00100000:1.0:1787833796.791907:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367228288 00000100:00100000:1.0:1787833796.791967:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 275 00000100:00100000:1.0:1787833796.791978:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367228288:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833796.792062:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367228288:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 86us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833796.792070:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 275 00000100:00100000:1.0:1787833796.792105:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367228416 00000100:00100000:1.0:1787833796.792108:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367228416 00000100:00100000:1.0:1787833796.792142:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367228672 00000100:00100000:1.0:1787833796.792145:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367228672 00000100:00100000:1.0:1787833796.792165:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:1.0:1787833796.792185:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367228416:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833796.792218:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367228416:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833796.792224:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:1.0:1787833796.792237:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:1.0:1787833796.792243:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2347:x1874679367228672:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833796.792283:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2347:x1874679367228672:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 40us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833796.792289:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00080000:3.0:1787833796.792648:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833796.792679:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367228544 00000100:00100000:3.0:1787833796.792683:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367228544 00000100:00100000:3.0:1787833796.792728:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:3.0:1787833796.792742:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367228544:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833796.792792:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367228544:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 51us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833796.792798:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00080000:1.0:1787833796.793118:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787833796.924549:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833797.180920:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477616580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375651840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833797.181001:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833797.181532:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375651840 00000100:00100000:1.0:1787833797.181540:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375651840 00000100:00100000:1.0:1787833797.181605:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787833797.181615:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375651840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833797.181649:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833797.181727:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375651840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833797.181735:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787833797.181886:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477616580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375651840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787833797.182382:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787833797.954499:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833798.974690:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833799.744366:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375652096:0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.744433:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833799.744498:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375652608:0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.744523:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833799.744548:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787833799.744552:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375651968:0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.744571:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833799.744583:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375652480:0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.744605:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833799.744627:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375652608 00000100:00100000:3.0:1787833799.744633:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375652608 00000100:00100000:3.0:1787833799.744690:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787833799.744699:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375652608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.744760:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375652608:12345-0@lo:400:kworker.0 Request processed in 62us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833799.744768:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787833799.744793:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375651968 00000100:00100000:3.0:1787833799.744809:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375651968 00000100:00100000:3.0:1787833799.744832:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787833799.744836:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375651968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.744870:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375651968:12345-0@lo:400:kworker.0 Request processed in 33us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833799.744874:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:3.0:1787833799.744897:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833799.744925:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375652352:0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.744929:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375651968:0@lo:400:kworker.0 00010000:00080000:3.0:1787833799.744955:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b646e1a12c0 x1874679375652608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833799.744965:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833799.744967:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375652608:0@lo:400:kworker.0 00000100:00100000:0.0:1787833799.744995:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833799.745003:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375652224:0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.745005:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375652352 00000100:00100000:3.0:1787833799.745009:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375652352 00000100:00100000:0.0:1787833799.745029:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833799.745035:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787833799.745040:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375652352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833799.745061:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375652096 00000100:00100000:0.0:1787833799.745066:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375652096 00000100:00100000:3.0:1787833799.745073:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375652352:12345-0@lo:400:kworker.0 Request processed in 33us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833799.745079:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787833799.745097:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833799.745099:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375652480 00000100:00100000:0.0:1787833799.745103:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375652480 00000100:00100000:3.0:1787833799.745122:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375652224 00000100:00100000:3.0:1787833799.745126:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375652224 00000100:00100000:3.0:1787833799.745149:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787833799.745156:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375652096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.745192:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375652096:12345-0@lo:400:kworker.0 Request processed in 36us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833799.745198:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787833799.745214:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787833799.745218:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375652480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.745239:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375652480:12345-0@lo:400:kworker.0 Request processed in 21us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833799.745242:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787833799.745248:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787833799.745251:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375652224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.745264:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375652224:12345-0@lo:400:kworker.0 Request processed in 12us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833799.745267:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1787833799.745276:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833799.745287:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375652480:0@lo:400:kworker.0 00000100:00100000:3.0:1787833799.745293:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375652096:0@lo:400:kworker.0 00000100:00100000:2.0:1787833799.746011:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375652224:0@lo:400:kworker.0 00000100:00100000:2.0:1787833799.746026:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375652352:0@lo:400:kworker.0 00010000:00010000:3.0:1787833799.996586:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833800.254604:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833800.254626:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375652736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833800.254714:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787833800.255433:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787833800.255830:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375652736 00000100:00100000:1.0:1787833800.255838:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375652736 00000100:00100000:1.0:1787833800.255887:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787833800.255898:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375652736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833800.255937:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833800.256022:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375652736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833800.256030:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787833800.257466:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b646e1a3c00 x1874679375652736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833800.257490:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375652736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787833801.026011:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833801.902938:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833801.902990:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833801.903075:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833801.903129:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833801.903476:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367228928 00000100:00100000:1.0:1787833801.903486:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367228928 00000100:00100000:1.0:1787833801.903550:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367229184 00000100:00100000:1.0:1787833801.903554:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367229184 00000100:00100000:1.0:1787833801.903576:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:1.0:1787833801.903585:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367228928:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833801.903649:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367228928:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 66us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833801.903668:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:1.0:1787833801.903684:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:1.0:1787833801.903690:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367229184:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833801.903724:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367229184:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 23us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833801.903730:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00080000:2.0:1787833801.903910:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833801.904851:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367229056 00000100:00100000:3.0:1787833801.904860:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367229056 00000100:00100000:3.0:1787833801.904931:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:3.0:1787833801.904941:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367229056:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833801.905007:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367229056:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 59us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833801.905014:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00080000:2.0:1787833801.905497:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833801.905941:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367228800 00000100:00100000:0.0:1787833801.905949:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367228800 00000100:00100000:0.0:1787833801.906040:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 277 00000100:00100000:0.0:1787833801.906049:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367228800:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833801.906124:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367228800:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 75us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833801.906131:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 277 00010000:00010000:2.0:1787833802.046223:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833802.300848:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477615680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375652864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833802.300925:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833802.301222:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375652864 00000100:00100000:1.0:1787833802.301230:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375652864 00000100:00100000:1.0:1787833802.301311:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787833802.301321:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375652864:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787833802.301624:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787833802.301692:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833802.301760:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375652864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 441us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833802.301769:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787833802.301854:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477615680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375652864:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787833803.069368:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833804.095395:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833804.860695:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375653376:0@lo:400:kworker.0 00000100:00100000:0.0:1787833804.860774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833804.860857:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833804.860864:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645288a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375653248:0@lo:400:kworker.0 00000100:00100000:0.0:1787833804.860894:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833804.860931:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375653248 00000100:00100000:0.0:1787833804.860939:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375653248 00000100:00100000:0.0:1787833804.860994:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787833804.861004:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375653248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833804.861054:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375653248:12345-0@lo:400:kworker.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833804.861062:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787833804.861119:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645288a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375653248:0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861225:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6452888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375652992:0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861261:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833804.861302:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f938780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375653504:0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861327:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833804.861371:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787833804.861377:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375653120:0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861401:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833804.861418:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f939a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375653632:0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861439:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787833804.861476:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833804.861489:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375653376 00000100:00100000:3.0:1787833804.861493:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375653376 00000100:00100000:3.0:1787833804.861529:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375653632 00000100:00100000:3.0:1787833804.861532:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375653632 00000100:00100000:3.0:1787833804.861554:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787833804.861560:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375653376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861597:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375653376:12345-0@lo:400:kworker.0 Request processed in 37us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833804.861603:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787833804.861616:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787833804.861622:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375653632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861654:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375653632:12345-0@lo:400:kworker.0 Request processed in 32us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833804.861660:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787833804.861676:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833804.861679:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833804.861696:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375653504 00000100:00100000:3.0:1787833804.861699:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375653504 00000100:00100000:3.0:1787833804.861723:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375653120 00000100:00100000:3.0:1787833804.861727:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375653120 00000100:00100000:3.0:1787833804.861751:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787833804.861757:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375653504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861788:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375653504:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833804.861794:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787833804.861806:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787833804.861813:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375653120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861840:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375653120:12345-0@lo:400:kworker.0 Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833804.861846:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1787833804.861859:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833804.861878:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64528892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375653120:0@lo:400:kworker.0 00010000:00080000:3.0:1787833804.861891:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b647f939a40 x1874679375653632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833804.861902:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f939a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375653632:0@lo:400:kworker.0 00000100:00100000:3.0:1787833804.861912:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f938780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375653504:0@lo:400:kworker.0 00000100:00100000:0.0:1787833804.862332:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375652992 00000100:00100000:0.0:1787833804.862370:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375652992 00000100:00100000:0.0:1787833804.862410:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787833804.862418:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375652992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833804.862460:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375652992:12345-0@lo:400:kworker.0 Request processed in 43us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833804.862467:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787833804.862509:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375653376:0@lo:400:kworker.0 00000100:00100000:2.0:1787833804.862581:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6452888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375652992:0@lo:400:kworker.0 00010000:00010000:2.0:1787833805.116546:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833805.372621:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375653760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833805.372716:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833805.373053:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375653760 00000100:00100000:0.0:1787833805.373061:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375653760 00000100:00100000:0.0:1787833805.373115:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787833805.373125:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375653760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833805.373159:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833805.373208:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375653760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833805.373231:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787833805.373312:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b646e1a3c00 x1874679375653760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833805.373331:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375653760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787833806.140540:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833807.024953:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833807.025834:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833807.025936:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367229312 00000100:00100000:0.0:1787833807.025947:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367229312 00000100:00100000:0.0:1787833807.026026:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 279 00000100:00100000:0.0:1787833807.026038:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367229312:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833807.026132:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367229312:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 97us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833807.026140:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 279 00000100:00100000:3.0:1787833807.033332:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367229440 00000100:00100000:3.0:1787833807.033362:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367229440 00000100:00100000:3.0:1787833807.033622:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:3.0:1787833807.033634:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367229440:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833807.033740:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367229440:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 109us (7910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833807.033748:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00080000:0.0:1787833807.033799:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833807.044718:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833807.044863:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367229568 00000100:00100000:3.0:1787833807.044875:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367229568 00000100:00100000:3.0:1787833807.044959:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787833807.044969:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+5:2343:x1874679367229568:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:3.0:1787833807.045016:0:8382:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774e9d 00000100:00080000:3.0:1787833807.045027:0:8382:0:(import.c:65:import_set_state_nolock()) ffff9b646e1c8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787833807.045072:0:8382:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1787833807.045099:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833807.045393:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+2:2343:x1874679367229568:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 424us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833807.045401:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00080000:0.0:1787833807.045583:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833807.051077:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833807.051393:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367229696 00000100:00100000:1.0:1787833807.051404:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367229696 00000100:00100000:1.0:1787833807.051478:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:1.0:1787833807.051490:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367229696:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833807.051581:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367229696:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 94us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833807.051590:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00080000:0.0:1787833807.051662:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787833807.164734:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833807.420854:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477616580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375653888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833807.420933:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833807.421155:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375653888 00000100:00100000:1.0:1787833807.421164:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375653888 00000100:00100000:1.0:1787833807.421249:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787833807.421260:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375653888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833807.421313:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833807.421577:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375653888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 309us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833807.421587:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787833807.421907:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833807.423420:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477616580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375653888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787833808.192420:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787833808.555032:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:3.0:1787833808.555040:0:6686:0:(genops.c:885:class_export_put()) final put ffff9b646e1ca800/320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:2.0:1787833808.555115:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b646e1ca800/320cb14b-678a-483a-8914-ee446104f369 for lustre-OST0000 00000020:00000080:2.0:1787833808.555172:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b646e1c8000 for lustre-OST0000 00010000:00010000:2.0:1787833809.213599:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833809.980992:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375654272:0@lo:400:kworker.0 00000100:00100000:0.0:1787833809.981068:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833809.981133:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833809.981140:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f938780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375654400:0@lo:400:kworker.0 00000100:00100000:0.0:1787833809.981168:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833809.981207:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375654272 00000100:00100000:0.0:1787833809.981214:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375654272 00000100:00100000:0.0:1787833809.981276:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787833809.981285:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375654272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833809.981359:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375654272:12345-0@lo:400:kworker.0 Request processed in 56us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833809.981378:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787833809.981402:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375654400 00000100:00100000:0.0:1787833809.981406:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375654400 00000100:00100000:0.0:1787833809.981431:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787833809.981437:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375654400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833809.981466:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375654400:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833809.981471:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787833809.981485:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833809.981489:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833809.981514:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f938780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375654400:0@lo:400:kworker.0 00000100:00100000:0.0:1787833809.981524:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375654272:0@lo:400:kworker.0 00000100:00100000:2.0:1787833809.981601:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375654016:0@lo:400:kworker.0 00000100:00100000:2.0:1787833809.981637:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833809.981688:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f939a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375654528:0@lo:400:kworker.0 00000100:00100000:2.0:1787833809.981723:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833809.981746:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787833809.981752:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375654144:0@lo:400:kworker.0 00000100:00100000:2.0:1787833809.981771:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833809.981785:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6452888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375654656:0@lo:400:kworker.0 00000100:00100000:2.0:1787833809.981803:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833809.981828:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375654656 00000100:00100000:2.0:1787833809.981831:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375654656 00000100:00100000:2.0:1787833809.981863:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787833809.981870:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375654656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833809.981903:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375654656:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833809.981909:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787833809.981925:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375654528 00000100:00100000:2.0:1787833809.981929:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375654528 00000100:00100000:2.0:1787833809.981949:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375654144 00000100:00100000:2.0:1787833809.981951:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375654144 00000100:00100000:2.0:1787833809.981969:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787833809.981975:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375654528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833809.982004:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375654528:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833809.982010:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787833809.982020:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787833809.982026:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375654144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833809.982048:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375654144:12345-0@lo:400:kworker.0 Request processed in 23us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833809.982053:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787833809.982080:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787833809.982083:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833809.982106:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375654144:0@lo:400:kworker.0 00010000:00080000:2.0:1787833809.982117:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6452888f00 x1874679375654656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833809.982127:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6452888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375654656:0@lo:400:kworker.0 00000100:00100000:2.0:1787833809.982136:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f939a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375654528:0@lo:400:kworker.0 00000100:00100000:0.0:1787833809.982505:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375654016 00000100:00100000:0.0:1787833809.982510:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375654016 00000100:00100000:1.0:1787833809.982726:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787833809.982737:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375654016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833809.982794:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375654016:12345-0@lo:400:kworker.0 Request processed in 59us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833809.982801:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787833809.982867:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375654016:0@lo:400:kworker.0 00010000:00010000:2.0:1787833810.237332:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833810.492952:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833810.492980:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375654784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833810.493069:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833810.493208:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375654784 00000100:00100000:1.0:1787833810.493215:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375654784 00000100:00100000:1.0:1787833810.493277:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787833810.493287:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375654784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833810.493324:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833810.493397:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375654784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833810.493404:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000040:00080000:3.0:1787833810.494144:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00080000:2.0:1787833810.494311:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64772d8b40 x1874679375654784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833810.494334:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375654784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787833811.265010:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787833811.289120:0:11829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:30:10 (1787833810) 00000100:00100000:2.0:1787833812.151833:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833812.151890:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833812.151937:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833812.152019:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367229824 00000100:00100000:0.0:1787833812.152030:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367229824 00000100:00100000:0.0:1787833812.157047:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 281 00000100:00100000:0.0:1787833812.157087:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367229824:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833812.157179:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367229824:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 118us (5288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833812.157186:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 281 00000100:00100000:1.0:1787833812.158765:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367229952 00000100:00100000:1.0:1787833812.158788:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367229952 00000100:00100000:1.0:1787833812.158919:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367230080 00000100:00100000:1.0:1787833812.158925:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367230080 00000100:00080000:2.0:1787833812.158931:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833812.158979:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:1.0:1787833812.158993:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+5:2344:x1874679367229952:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833812.159034:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:0.0:1787833812.159057:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367230080:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833812.159110:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+5:2344:x1874679367229952:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 118us (7285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833812.159139:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:0.0:1787833812.159467:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367230080:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 420us (7528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833812.159476:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 122 00010000:00010000:2.0:1787833812.284649:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833812.540687:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375654912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833812.540773:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833812.540963:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375654912 00000100:00100000:1.0:1787833812.540986:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375654912 00000100:00100000:1.0:1787833812.541053:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787833812.541062:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375654912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833812.541100:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833812.541146:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375654912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833812.541154:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787833812.542430:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833812.542479:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375654912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833813.248875:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833813.249004:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367230208 00000100:00100000:1.0:1787833813.249015:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367230208 00000100:00100000:1.0:1787833813.249261:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:1.0:1787833813.249273:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+5:10216:x1874679367230208:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833813.249296:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833813.249319:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e774f68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a8f expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833813.249553:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833813.249569:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833813.249582:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833813.249806:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787833813.249811:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833813.249918:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833813.249945:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e774f68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a8f expref: 7 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833813.249963:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a8f expref: 6 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833813.249973:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01000) 00010000:00010000:1.0:1787833813.249976:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833813.249980:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198000, rc 0) 00000100:00100000:1.0:1787833813.250157:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+6:10216:x1874679367230208:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 886us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833813.250165:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:2.0:1787833813.276687:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833813.276830:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367230336 00000100:00100000:3.0:1787833813.276841:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367230336 00000100:00100000:3.0:1787833813.276899:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:3.0:1787833813.276911:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+6:10217:x1874679367230336:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833813.276934:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833813.276955:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e774f76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a96 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.277056:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.277071:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.277082:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.277097:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.277105:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.277113:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.277895:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d000/0x2bdb54ee5e774f8b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.277909:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d000/0x2bdb54ee5e774f8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.277919:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d000/0x2bdb54ee5e774f8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833813.278012:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787833813.278018:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833813.280856:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d000/0x2bdb54ee5e774f8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280892:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280900:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280908:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280914:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833813.280919:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280928:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280946:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01000) 00010000:00010000:3.0:1787833813.280950:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833813.280956:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280963:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280976:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280983:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.280989:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.281000:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833813.281003:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.281009:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.281018:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833813.281020:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833813.281023:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.281041:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774f84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.281088:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e774f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a96 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.281103:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d000/0x2bdb54ee5e774f8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a96 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833813.281111:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b645a7d3400) 00010000:00010000:3.0:1787833813.281113:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833813.281116:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2d000, rc 0) 00000100:00100000:3.0:1787833813.281193:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+7:10217:x1874679367230336:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 4283us (4514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833813.281202:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:0.0:1787833813.286750:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833813.286838:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367230592 00000100:00100000:2.0:1787833813.286849:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367230592 00000100:00100000:2.0:1787833813.286919:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:2.0:1787833813.286930:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+7:10217:x1874679367230592:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833813.286950:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833813.286969:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e774f92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3a9d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.287055:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.287071:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.287082:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.287144:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.287152:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.287158:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.287963:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774fa7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.287976:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.287991:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833813.288002:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787833813.290854:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290873:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290881:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290888:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833813.290892:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290901:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290919:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b645a7d3400) 00010000:00010000:2.0:1787833813.290922:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833813.290928:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290935:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774f99 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290955:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290962:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290983:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290988:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833813.290991:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.290998:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.291007:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b6474279900) 00010000:00010000:2.0:1787833813.291010:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833813.291013:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.291018:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e774fa0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.292119:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e774f92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a9d expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.292144:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a9d expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833813.292153:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:2.0:1787833813.292155:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833813.292158:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83000, rc 0) 00000100:00100000:2.0:1787833813.294774:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+9:10217:x1874679367230592:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 7835us (8025us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787833813.294805:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:2.0:1787833813.305447:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833813.305597:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367230720 00000100:00100000:3.0:1787833813.305647:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367230720 00000100:00100000:3.0:1787833813.305702:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:3.0:1787833813.305713:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+9:10217:x1874679367230720:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787833813.305826:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+9:10217:x1874679367230720:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 Request processed in 114us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833813.305834:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00010000:00010000:2.0:1787833813.309395:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787833813.571639:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1787833813.662438:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1787833814.337807:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833815.100829:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375655040:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.100909:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833815.101014:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375655040 00000100:00100000:1.0:1787833815.101021:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375655040 00000100:00100000:1.0:1787833815.101072:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787833815.101082:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375655040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.101237:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375655168:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.101272:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833815.101307:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375655168 00000100:00100000:3.0:1787833815.101311:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375655168 00000100:00100000:3.0:1787833815.101363:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787833815.101366:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375655040:12345-0@lo:400:kworker.0 Request processed in 286us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833815.101370:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375655168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833815.101374:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787833815.101420:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375655168:12345-0@lo:400:kworker.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833815.101427:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787833815.101451:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375655168:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.101698:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375655424:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.101729:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833815.101754:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833815.101760:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375655296:0@lo:400:kworker.0 00000100:00100000:1.0:1787833815.101775:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375655680:0@lo:400:kworker.0 00000100:00100000:3.0:1787833815.101783:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833815.101799:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833815.101817:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833815.101822:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375655552:0@lo:400:kworker.0 00000100:00100000:1.0:1787833815.101856:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833815.101890:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375655424 00000100:00100000:1.0:1787833815.101895:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375655424 00000100:00100000:1.0:1787833815.101933:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375655680 00000100:00100000:1.0:1787833815.101936:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375655680 00000100:00100000:1.0:1787833815.101960:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787833815.101967:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375655424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833815.102073:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375655424:12345-0@lo:400:kworker.0 Request processed in 106us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.102079:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787833815.102092:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787833815.102098:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375655680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833815.102208:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375655680:12345-0@lo:400:kworker.0 Request processed in 110us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.102214:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787833815.102231:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833815.102235:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833815.102260:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375655424:0@lo:400:kworker.0 00010000:00080000:1.0:1787833815.102378:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b64772db480 x1874679375655680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833815.102380:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375655296 00000100:00100000:3.0:1787833815.102384:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375655296 00000100:00100000:1.0:1787833815.102389:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375655680:0@lo:400:kworker.0 00000100:00100000:2.0:1787833815.102522:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375655552 00000100:00100000:2.0:1787833815.102527:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375655552 00000100:00100000:3.0:1787833815.102540:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787833815.102546:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375655296:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787833815.102573:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833815.102585:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375655296:12345-0@lo:400:kworker.0 Request processed in 39us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.102591:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375655296:0@lo:400:kworker.0 00000100:00100000:0.0:1787833815.105098:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375655040:0@lo:400:kworker.0 00000100:00100000:2.0:1787833815.107444:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787833815.107463:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477616940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375655552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833815.107576:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477616940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375655552:12345-0@lo:400:kworker.0 Request processed in 121us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833815.107584:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787833815.109656:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787833815.110403:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375655552:0@lo:400:kworker.0 00010000:00010000:2.0:1787833815.361793:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833815.511125:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833815.511198:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367230848 00000100:00100000:3.0:1787833815.511207:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367230848 00000100:00100000:3.0:1787833815.511275:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:3.0:1787833815.511285:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+8:10259:x1874679367230848:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833815.511306:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833815.511328:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e774fb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3aa4 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511404:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511416:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511425:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511445:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511451:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511457:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511746:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511752:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511761:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511765:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833815.511768:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511773:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511782:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01000) 00010000:00010000:3.0:1787833815.511783:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833815.511787:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511790:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774fbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511799:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511802:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511806:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511809:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833815.511810:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511820:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511825:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833815.511826:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833815.511828:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511831:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511853:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e774fb5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aa4 expref: 9 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511859:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01000) 00010000:00010000:3.0:1787833815.511860:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833815.511862:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e774fb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aa4 expref: 9 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.511867:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2d600, rc 0) 00000100:00100000:3.0:1787833815.511917:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+8:10259:x1874679367230848:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 635us (804us total) trans 0 rc 301/301 00000100:00100000:3.0:1787833815.511922:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00080000:0.0:1787833815.513087:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833815.516278:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833815.517770:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367231104 00000100:00100000:2.0:1787833815.517785:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367231104 00000100:00100000:2.0:1787833815.517856:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:2.0:1787833815.517865:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+8:10259:x1874679367231104:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:2.0:1787833815.517922:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833815.517951:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e774f6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a8f expref: 8 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.517968:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6451e01000) 00010000:00010000:2.0:1787833815.517978:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833815.518661:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.518687:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.518698:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.518712:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.518719:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.518727:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833815.519983:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787833815.519998:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.520007:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.520013:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.520019:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833815.520024:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.520031:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.520058:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:2.0:1787833815.520061:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833815.520066:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.520072:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833815.520092:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027c15046 reply state 0000000064bd380b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833815.520102:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833815.520253:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+9:10259:x1874679367231104:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 2384us (3980us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787833815.520263:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00010000:00010000:1.0:1787833815.522276:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.522318:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.522326:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.522333:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833815.522374:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.522385:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.522401:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b6474279700) 00010000:00010000:1.0:1787833815.522404:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833815.522409:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.522416:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fd1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833815.593235:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833815.593371:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367231232 00000100:00100000:2.0:1787833815.593384:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367231232 00000100:00100000:2.0:1787833815.593450:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:2.0:1787833815.593462:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+8:10267:x1874679367231232:12345-192.168.202.15@tcp:101:lctl.0 00010000:00010000:2.0:1787833815.593495:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833815.593525:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3aab expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.593619:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.593637:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.593683:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833815.593754:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787833815.593759:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833815.593818:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.593847:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e774fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aab expref: 10 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.593871:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aab expref: 9 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.593880:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:2.0:1787833815.593884:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833815.593887:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83e00, rc 0) 00000100:00100000:2.0:1787833815.593956:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+9:10267:x1874679367231232:12345-192.168.202.15@tcp:101:lctl.0 Request processed in 495us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833815.593963:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:1.0:1787833815.618486:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375655808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833815.618607:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833815.618698:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375655808 00000100:00100000:1.0:1787833815.618706:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375655808 00000100:00100000:1.0:1787833815.618805:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787833815.618817:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375655808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833815.618870:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833815.619080:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375655808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 264us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.619102:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787833815.619148:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6477614f00 x1874679375655808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833815.619170:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375655808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833815.704121:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833815.704225:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367231360 00000100:00100000:2.0:1787833815.704236:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367231360 00000100:00100000:3.0:1787833815.704829:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:3.0:1787833815.704840:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+9:10273:x1874679367231360:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787833815.704873:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833815.704895:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e774fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ab2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705079:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705094:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705105:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705119:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705125:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705131:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705265:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c800/0x2bdb54ee5e774ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705478:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c800/0x2bdb54ee5e774ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705488:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c800/0x2bdb54ee5e774ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833815.705703:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787833815.705716:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833815.705771:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c800/0x2bdb54ee5e774ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705786:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705793:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705801:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705807:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833815.705811:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705819:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705831:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:3.0:1787833815.705834:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833815.705845:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705851:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e774fed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705864:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705870:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705888:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705892:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833815.705895:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705902:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705911:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833815.705913:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833815.705916:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705922:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e774ff4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705956:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e774fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab2 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705970:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c800/0x2bdb54ee5e774ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab2 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833815.705977:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:3.0:1787833815.705979:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787833815.705982:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c800, rc 0) 00000100:00100000:3.0:1787833815.706263:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+10:10273:x1874679367231360:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1424us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833815.706293:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787833815.712302:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833815.712476:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367231616 00000100:00100000:2.0:1787833815.712486:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367231616 00000100:00100000:2.0:1787833815.712580:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:2.0:1787833815.712602:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+10:10273:x1874679367231616:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787833815.712624:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833815.712644:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e775002 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ab9 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.712795:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.712812:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.712825:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.712887:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.712895:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.712903:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787833815.713549:0:7195:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787833815.713743:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713754:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713762:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713797:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713813:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713820:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713825:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833815.713830:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713838:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713850:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833815.713853:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833815.713858:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713864:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82a00/0x2bdb54ee5e775009 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833815.713878:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f95b3880 reply state 00000000986e9925 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833815.713886:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787833815.713917:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82200/0x2bdb54ee5e775002 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab9 expref: 13 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713932:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab9 expref: 12 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.713950:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279500) 00010000:00010000:2.0:1787833815.713953:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833815.713955:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2c00, rc 0) 00000100:00100000:2.0:1787833815.714028:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+13:10273:x1874679367231616:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1439us (1736us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787833815.714037:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:0.0:1787833815.717721:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833815.717800:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367231744 00000100:00100000:1.0:1787833815.717811:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367231744 00000100:00100000:1.0:1787833815.717859:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:1.0:1787833815.717868:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1874679367231744:12345-192.168.202.15@tcp:8:bash.0 00010000:00080000:1.0:1787833815.717902:0:6659:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:1.0:1787833815.717937:0:6659:0:(genops.c:1385:class_connect()) connect: client 320cb14b-678a-483a-8914-ee446104f369, cookie 0x2bdb54ee5e775025 00002000:00100000:1.0:1787833815.717950:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 320cb14b-678a-483a-8914-ee446104f369/ffff9b6481737800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787833815.717962:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:1.0:1787833815.718201:0:6659:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787833815.718229:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b6481736800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833815.718300:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:2343:x1874679367231744:12345-192.168.202.15@tcp:8:bash.0 Request processed in 431us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.718309:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00010000:00010000:2.0:1787833815.718857:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.718871:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.718879:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.718885:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833815.718890:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.718897:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.718915:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6474279300) 00010000:00010000:2.0:1787833815.718918:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833815.718923:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.718930:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82600/0x2bdb54ee5e775010 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833815.720584:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833815.720684:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367231872 00000100:00100000:1.0:1787833815.720695:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367231872 00000100:00100000:1.0:1787833815.720814:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:1.0:1787833815.720824:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+6:0:x1874679367231872:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787833815.720842:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833815.720866:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ac0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787833815.720917:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833815.720937:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=294s v=(0 0) 00010000:00010000:1.0:1787833815.720942:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833815.720952:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac0 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.720972:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac0 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.720986:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198000, rc 0) 00000100:00100000:1.0:1787833815.721047:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+7:0:x1874679367231872:12345-192.168.202.15@tcp:101:bash.0 Request processed in 224us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.721054:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00080000:0.0:1787833815.721657:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833815.723750:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833815.723828:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367232000 00000100:00100000:1.0:1787833815.723836:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367232000 00000100:00100000:1.0:1787833815.723899:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:1.0:1787833815.723909:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:10273:x1874679367232000:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787833815.723926:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833815.723944:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ac7 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.723974:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac0 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.724000:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833815.724004:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833815.724010:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.724044:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac0 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.724058:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac0 expref: 8 pid: 6661 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833815.724073:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1874679375655936:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833815.724215:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833815.728333:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833815.728456:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367232128 00000100:00100000:2.0:1787833815.728465:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367232128 00010000:00010000:2.0:1787833815.728509:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac0 expref: 9 pid: 6661 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833815.728541:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:2.0:1787833815.728557:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2345:x1874679367232128:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833815.728572:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833815.728608:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac0 expref: 9 pid: 6661 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.728623:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac0 expref: 9 pid: 6661 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.728650:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833815.728654:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833815.728662:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.728672:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.728711:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833815.728747:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772d92c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1874679375656064:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787833815.728837:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833815.730612:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772d92c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1874679375656064:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787833815.730639:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833815.730688:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2345:x1874679367232128:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 2138us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833815.730698:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00010000:00010000:1.0:1787833815.733512:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030768d33/0x2bdb54ee5e77502c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac0 expref: 8 pid: 6661 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833815.733538:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1874679375655936:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833815.733643:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.733660:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198800, rc 0) 00000100:00100000:1.0:1787833815.733777:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:10273:x1874679367232000:12345-192.168.202.15@tcp:101:bash.0 Request processed in 9869us (10036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.733805:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787833815.741705:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833815.742045:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367232384 00000100:00100000:2.0:1787833815.742055:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367232384 00000100:00100000:3.0:1787833815.742217:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787833815.742227:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+12:10273:x1874679367232384:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:3.0:1787833815.742915:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+13:10273:x1874679367232384:12345-192.168.202.15@tcp:35:bash.0 Request processed in 686us (1218us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787833815.742924:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787833815.820981:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833815.823562:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367232640 00000100:00100000:2.0:1787833815.823595:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367232640 00000100:00100000:2.0:1787833815.823680:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:2.0:1787833815.823689:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+13:10283:x1874679367232640:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833815.823713:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833815.823731:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77503a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ace expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833815.823835:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787833815.823927:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77503a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ace expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.823939:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:2.0:1787833815.823941:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833815.823945:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77503a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ace expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.823955:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3400, rc 0) 00000100:00100000:2.0:1787833815.824024:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+14:10283:x1874679367232640:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 335us (3051us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787833815.824031:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:1.0:1787833815.827191:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833815.827310:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367232896 00000100:00100000:0.0:1787833815.827320:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367232896 00000100:00100000:0.0:1787833815.827410:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787833815.827422:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+14:10283:x1874679367232896:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787833815.828019:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+15:10283:x1874679367232896:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 598us (838us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787833815.828041:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787833815.910461:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833815.910741:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367233024 00000100:00100000:1.0:1787833815.910754:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367233024 00000100:00100000:2.0:1787833815.910935:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:2.0:1787833815.910948:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+15:10289:x1874679367233024:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833815.910976:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833815.911009:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e775048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ad5 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.911076:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77504f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.911091:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77504f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.911104:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77504f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833815.911173:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787833815.911177:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833815.911200:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77504f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.911229:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e775048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ad5 expref: 17 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.911247:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77504f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ad5 expref: 16 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.911255:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833815.911258:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833815.911261:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2a00, rc 0) 00000100:00100000:2.0:1787833815.911403:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+16:10289:x1874679367233024:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 458us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833815.911420:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787833815.920084:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833815.920244:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367233280 00000100:00100000:2.0:1787833815.920255:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367233280 00000100:00100000:2.0:1787833815.920325:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:2.0:1787833815.920335:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477616580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+16:10289:x1874679367233280:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833815.920404:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833815.920428:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e775056 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3adc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.920532:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e77505d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.920554:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e77505d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.920573:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e77505d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833815.920584:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787833815.920718:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e775056 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3adc expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.920736:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e77505d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3adc expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.920744:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279500) 00010000:00010000:2.0:1787833815.920747:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833815.920750:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3200, rc 0) 00000100:00100000:2.0:1787833815.920834:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477616580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+18:10289:x1874679367233280:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 488us (751us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787833815.920842:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787833815.929373:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833815.929466:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833815.929575:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367233664 00000100:00100000:1.0:1787833815.929595:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367233664 00000100:00100000:1.0:1787833815.929666:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787833815.929677:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+18:2345:x1874679367233664:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833815.929693:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833815.929719:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e77505d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3adc expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.929738:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279500) 00010000:00010000:1.0:1787833815.929743:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833815.929806:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+17:2345:x1874679367233664:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 131us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833815.929814:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:2.0:1787833815.930963:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367233536 00000100:00100000:2.0:1787833815.930973:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367233536 00000100:00100000:2.0:1787833815.931288:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:2.0:1787833815.931301:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+17:10289:x1874679367233536:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833815.931332:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833815.931378:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77506b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ae3 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.931486:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775072 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.931502:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775072 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.931513:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775072 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833815.931525:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787833815.931902:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77506b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ae3 expref: 20 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.931922:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775072 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ae3 expref: 19 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.931931:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279500) 00010000:00010000:2.0:1787833815.931934:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787833815.931952:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2600, rc 0) 00000100:00100000:2.0:1787833815.932031:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+19:10289:x1874679367233536:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 733us (2699us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787833815.932039:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:3.0:1787833815.940244:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833815.940366:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367233792 00000100:00100000:1.0:1787833815.940377:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367233792 00000100:00100000:1.0:1787833815.940428:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:1.0:1787833815.940438:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+7:2346:x1874679367233792:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:1.0:1787833815.940480:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.940500:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.940521:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833815.940526:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833815.940530:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.940741:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833815.940757:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 7 pid: 6659 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833815.940774:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477615680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6661:1874679375656192:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833815.940939:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833815.944195:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477615680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6661:1874679375656192:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833815.944227:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833815.946760:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833815.948457:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367233920 00000100:00100000:2.0:1787833815.948472:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367233920 00002000:00100000:2.0:1787833815.948526:0:6664:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9b6445622940 x1874679367233920/t0(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:621/0 lens 504/0 e 0 to 0 dl 1787833826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787833815.948539:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6445622940 with x1874679367233920 ext(0->12) 00010000:00010000:2.0:1787833815.948560:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 8 pid: 6659 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833815.948598:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 8 pid: 6659 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833815.948606:0:6664:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b6445622940 00000100:00100000:2.0:1787833815.948644:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787833815.948654:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445622940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367233920:12345-192.168.202.15@tcp:4:lfs.0 00000001:00100000:3.0:1787833816.039950:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000100:00100000:2.0:1787833816.040968:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445622940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+9:2344:x1874679367233920:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 92308us (94210us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787833816.041107:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00002000:00100000:2.0:1787833816.041125:0:6664:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9b6445622940 x1874679367233920/t4294967299(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:621/0 lens 504/448 e 0 to 0 dl 1787833826 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787833816.041138:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6445622940 with x1874679367233920 ext(0->12) 00010000:00010000:2.0:1787833816.041151:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 9 pid: 6659 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.041183:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 9 pid: 6659 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833816.041193:0:6664:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b6445622940 00000100:00100000:0.0:1787833816.055213:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833816.055326:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367234048 00000100:00100000:2.0:1787833816.055367:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367234048 00010000:00010000:2.0:1787833816.055411:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 9 pid: 6659 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833816.055457:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787833816.055467:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2347:x1874679367234048:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833816.055482:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787833816.055499:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787833816.055502:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787833815 00002000:00010000:2.0:1787833816.055505:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787833816 00002000:00010000:2.0:1787833816.055507:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787833815 00010000:00010000:2.0:1787833816.055514:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 9 pid: 6659 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.055529:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 9 pid: 6659 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.055557:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c597872f/0x2bdb54ee5e775033 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ac7 expref: 9 pid: 6659 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.055620:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833816.055624:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833816.055630:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.055640:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.055665:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833816.055720:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+8:2347:x1874679367234048:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 253us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833816.055728:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00010000:00010000:0.0:1787833816.057095:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.057114:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.057150:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.057159:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.057168:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.057175:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833816.057180:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.057188:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.057209:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.057229:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712ab0a4/0x2bdb54ee5e775080 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833816.057329:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+7:2346:x1874679367233792:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 116887us (117092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833816.057381:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:0.0:1787833816.064034:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833816.064142:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367234304 00000100:00100000:1.0:1787833816.064154:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367234304 00000100:00100000:1.0:1787833816.064223:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787833816.064234:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+19:10289:x1874679367234304:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:1.0:1787833816.064305:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775072 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ae3 expref: 19 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833816.064876:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787833816.064938:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787833816.068222:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787833816.070804:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.070835:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab9 expref: 23 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.070844:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.070890:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab9 expref: 23 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.070906:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab9 expref: 23 pid: 7195 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833816.070921:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64773b9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1874679375656320:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833816.071025:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64457c0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787833816.079286:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64773b9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1874679375656320:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833816.079318:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833816.085199:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833816.088177:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367234432 00000100:00100000:3.0:1787833816.088195:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367234432 00010000:00010000:3.0:1787833816.088254:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab9 expref: 24 pid: 7195 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833816.088413:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:3.0:1787833816.088425:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+24:2345:x1874679367234432:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833816.088442:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833816.088450:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab9 expref: 24 pid: 7195 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.088489:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab9 expref: 24 pid: 7195 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.088515:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e775017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab9 expref: 24 pid: 7195 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.088534:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279500) 00010000:00010000:3.0:1787833816.088540:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.088561:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.088570:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.088604:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833816.088684:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+23:2345:x1874679367234432:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 261us (3494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833816.088692:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00010000:00010000:0.0:1787833816.089279:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.089290:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833816.090427:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787833816.090700:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787833816.090848:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64773b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874679375656448:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787833816.092362:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833816.092434:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375656448 00000100:00100000:0.0:1787833816.092443:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375656448 00000100:00100000:0.0:1787833816.092492:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833816.092502:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1874679375656448:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787833816.092612:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1874679375656448:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833816.092620:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833816.092650:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64457c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833816.092679:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64773b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874679375656448:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787833816.097274:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787833816.097662:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64773b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874679375656576:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787833816.097730:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833816.097813:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64457c0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787833816.097861:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375656576 00000100:00100000:2.0:1787833816.097869:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375656576 00000100:00100000:2.0:1787833816.097947:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833816.097958:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1874679375656576:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787833816.098749:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5819:x1874679375656576:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 788us (1013us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787833816.098759:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833816.098954:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64773b8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874679375656576:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787833816.099116:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787833816.099169:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.099180:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.099207:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.099213:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833816.099218:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.099226:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.099245:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279500) 00010000:00010000:3.0:1787833816.099248:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787833816.099253:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.099260:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775087 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787833816.099875:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787833816.100183:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787833816.100203:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 294855862516ns, next at 295855860629ns, rc = 0 00000001:00080000:0.0:1787833816.100211:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787833816.100249:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279500) 00010000:00010000:0.0:1787833816.100252:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787833816.100260:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775072 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ae3 expref: 27 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833816.100701:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+26:10289:x1874679367234304:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 36467us (36676us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787833816.100712:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000020:00080000:0.0:1787833816.100717:0:5819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787833816.104702:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833816.104806:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367234560 00000100:00100000:2.0:1787833816.104819:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367234560 00000100:00100000:2.0:1787833816.104916:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:2.0:1787833816.104929:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+26:10289:x1874679367234560:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833816.104954:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833816.104975:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77508e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3aea expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.105061:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77508e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aea expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.105076:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77508e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aea expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.105093:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:2.0:1787833816.105096:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833816.105099:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3600, rc 0) 00000100:00100000:2.0:1787833816.105165:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+27:10289:x1874679367234560:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 237us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833816.105172:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787833816.110060:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833816.110143:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367234816 00000100:00100000:3.0:1787833816.110154:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367234816 00000100:00100000:3.0:1787833816.110214:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787833816.110224:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+27:10289:x1874679367234816:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833816.111032:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+28:10289:x1874679367234816:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 807us (979us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787833816.111042:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787833816.275039:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833816.275219:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367235072 00000100:00100000:3.0:1787833816.275231:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367235072 00000100:00100000:3.0:1787833816.275752:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787833816.275766:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477615680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+28:10299:x1874679367235072:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833816.275794:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833816.275816:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3af1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833816.275959:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787833816.276093:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775095 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af1 expref: 30 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.276109:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:3.0:1787833816.276113:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833816.276118:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af1 expref: 30 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833816.276135:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2de00, rc 0) 00000100:00100000:3.0:1787833816.276216:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477615680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+29:10299:x1874679367235072:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 454us (1187us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787833816.276224:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787833816.279285:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833816.279386:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367235200 00000100:00100000:1.0:1787833816.279395:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367235200 00000100:00100000:1.0:1787833816.279459:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787833816.279470:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64456203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+29:10299:x1874679367235200:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:1.0:1787833816.279555:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279573:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279598:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279615:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279623:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279630:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279730:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279759:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279766:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833816.279815:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279829:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279834:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279841:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279847:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833816.279850:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279858:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279869:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833816.279872:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833816.279876:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279882:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279903:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279909:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279914:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279919:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833816.279922:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279928:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279936:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6451e01700) 00010000:00010000:1.0:1787833816.279938:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833816.279941:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279947:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279960:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279965:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.279971:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.280058:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833816.280062:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.280069:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.280078:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833816.280081:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833816.280085:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.280091:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7750b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833816.280176:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64456203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+29:10299:x1874679367235200:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 707us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833816.280185:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787833816.284065:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833816.284166:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367235456 00000100:00100000:0.0:1787833816.284179:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367235456 00000100:00100000:0.0:1787833816.284304:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787833816.284314:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+29:10299:x1874679367235456:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787833816.284648:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+30:10299:x1874679367235456:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 334us (664us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787833816.284656:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787833816.317382:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833816.317569:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367235712 00000100:00100000:2.0:1787833816.317580:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367235712 00000100:00100000:2.0:1787833816.317690:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787833816.317702:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64456230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+30:10303:x1874679367235712:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833816.317730:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833816.317753:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e7750b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3af8 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.317848:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.317885:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.317897:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.317914:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.317921:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.317927:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318071:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318080:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318088:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833816.318099:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787833816.318197:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318205:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318213:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318225:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833816.318229:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318236:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318250:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833816.318253:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833816.318258:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318263:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7750bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318385:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318391:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318398:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318403:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833816.318406:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318412:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318434:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6474279300) 00010000:00010000:2.0:1787833816.318436:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833816.318440:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318446:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318492:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e7750b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af8 expref: 33 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318506:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af8 expref: 32 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.318514:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:2.0:1787833816.318517:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833816.318519:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3c00, rc 0) 00000100:00100000:2.0:1787833816.318605:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64456230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+32:10303:x1874679367235712:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 905us (1270us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787833816.318614:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:0.0:1787833816.323948:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833816.324012:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367235840 00000100:00100000:1.0:1787833816.324021:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367235840 00000100:00100000:1.0:1787833816.324081:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787833816.324092:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+32:10303:x1874679367235840:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:1.0:1787833816.324481:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.324501:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.324533:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.324703:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.324712:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.324719:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.324725:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833816.324730:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.324738:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.324750:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833816.324754:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833816.324759:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.324765:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833816.324874:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+32:10303:x1874679367235840:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 783us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833816.324883:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787833816.328932:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833816.329023:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367236096 00000100:00100000:2.0:1787833816.329033:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367236096 00000100:00100000:2.0:1787833816.329118:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787833816.329129:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+32:10303:x1874679367236096:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833816.329416:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+33:10303:x1874679367236096:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 288us (492us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787833816.329424:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00010000:00010000:2.0:1787833816.380714:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833816.618449:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833816.618577:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367236352 00000100:00100000:1.0:1787833816.618598:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367236352 00000100:00100000:1.0:1787833816.618669:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:1.0:1787833816.618680:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445621680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+33:10333:x1874679367236352:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:1.0:1787833816.618709:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833816.618732:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3aff expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.618852:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.618867:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.618879:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833816.618890:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787833816.619031:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7750e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aff expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.619050:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aff expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.619058:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833816.619061:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833816.619064:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199200, rc 0) 00000100:00100000:1.0:1787833816.619131:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445621680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+35:10333:x1874679367236352:12345-192.168.202.15@tcp:101:cat.0 Request processed in 452us (690us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787833816.619159:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:3.0:1787833816.637732:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833816.638062:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367236608 00000100:00100000:2.0:1787833816.638073:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367236608 00000100:00100000:2.0:1787833816.638212:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:2.0:1787833816.638223:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445620f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+35:10333:x1874679367236608:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:2.0:1787833816.638888:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445620f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+36:10333:x1874679367236608:12345-192.168.202.15@tcp:35:cat.0 Request processed in 665us (1166us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787833816.638898:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787833816.643229:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833816.643558:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367236736 00000100:00100000:1.0:1787833816.643569:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367236736 00000100:00100000:1.0:1787833816.643659:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:1.0:1787833816.643670:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644600a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+36:2344:x1874679367236736:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833816.643686:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833816.643709:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7750e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aff expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.643729:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833816.643734:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833816.643788:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644600a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+35:2344:x1874679367236736:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 119us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833816.643794:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787833816.703800:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833816.703921:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367236992 00000100:00100000:2.0:1787833816.703932:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367236992 00000100:00100000:2.0:1787833816.703999:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:2.0:1787833816.704010:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64456221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+35:10340:x1874679367236992:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:2.0:1787833816.704034:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833816.704037:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787833816.704061:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77504f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ad5 expref: 35 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.704079:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833816.704084:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833816.704095:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e7750f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b06 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.704192:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.704204:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af8 expref: 35 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.704228:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.704259:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af8 expref: 35 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.704272:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af8 expref: 35 pid: 7195 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833816.704286:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375656704:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833816.706359:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf000 going to sleep for 11 seconds 00000100:00100000:2.0:1787833816.721566:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375656704:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833816.721605:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833816.723487:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833816.723614:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367237120 00000100:00100000:0.0:1787833816.723623:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367237120 00010000:00010000:0.0:1787833816.723664:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af8 expref: 36 pid: 7195 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833816.723709:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:0.0:1787833816.723718:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445623840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+36:2345:x1874679367237120:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833816.723749:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833816.723757:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af8 expref: 36 pid: 7195 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.723770:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af8 expref: 36 pid: 7195 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.723791:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7750cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3af8 expref: 36 pid: 7195 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.723809:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833816.723813:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.723822:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.723829:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.723865:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833816.723916:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445623840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+35:2345:x1874679367237120:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 199us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833816.723923:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00010000:00010000:2.0:1787833816.723998:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.724007:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833816.724026:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787833816.724202:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e7750f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b06 expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.724216:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b06 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.724235:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:2.0:1787833816.724238:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787833816.724241:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3a00, rc 0) 00000100:00100000:2.0:1787833816.724269:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64456221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+35:10340:x1874679367236992:12345-192.168.202.15@tcp:101:dd.0 Request processed in 20261us (20479us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787833816.724276:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:3.0:1787833816.729643:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833816.729728:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367237376 00000100:00100000:2.0:1787833816.729738:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367237376 00000100:00100000:2.0:1787833816.729804:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:2.0:1787833816.729815:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445622d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+35:10340:x1874679367237376:12345-192.168.202.15@tcp:36:dd.0 00010000:00010000:2.0:1787833816.730101:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.730118:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833816.730131:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833816.730184:0:7195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787833816.730210:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f7672c0 reply state 00000000798c7b58 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833816.730220:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833816.730462:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445622d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+38:10340:x1874679367237376:12345-192.168.202.15@tcp:36:dd.0 Request processed in 646us (827us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787833816.730470:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000020:00080000:2.0:1787833816.730489:0:7195:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787833816.736010:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.736030:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.736038:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.736044:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833816.736057:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.736065:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.736099:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833816.736102:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833816.736108:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.736114:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77510c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833816.926025:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833816.926126:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367237504 00000100:00100000:1.0:1787833816.926136:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367237504 00000100:00100000:1.0:1787833816.926195:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:1.0:1787833816.926203:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+37:10354:x1874679367237504:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:1.0:1787833816.926226:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833816.926242:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775113 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b0d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926301:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926316:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926329:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926367:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926376:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926402:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926495:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926505:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b06 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926513:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926545:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b06 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.926559:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b06 expref: 38 pid: 5816 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833816.926573:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375656832:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833816.926680:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d7780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833816.928800:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375656832:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833816.928830:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833816.929520:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833816.929619:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367237760 00000100:00100000:2.0:1787833816.929627:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367237760 00000100:00100000:2.0:1787833816.929684:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787833816.929693:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+39:5587:x1874679367237760:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787833816.930025:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+40:5587:x1874679367237760:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 332us (505us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787833816.930033:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787833816.931915:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833816.931985:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367237888 00000100:00100000:0.0:1787833816.931992:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367237888 00010000:00010000:0.0:1787833816.932032:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b06 expref: 40 pid: 5816 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833816.932097:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787833816.932106:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64456212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+40:2345:x1874679367237888:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833816.932121:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833816.932128:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b06 expref: 40 pid: 5816 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.932141:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b06 expref: 40 pid: 5816 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.932163:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e7750fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b06 expref: 40 pid: 5816 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.932177:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833816.932181:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.932188:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.932193:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833816.932217:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833816.932260:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64456212c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+39:2345:x1874679367237888:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 156us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833816.932265:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00010000:00010000:1.0:1787833816.932531:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932537:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833816.932588:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787833816.932593:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833816.932633:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932647:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932656:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932662:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932669:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932675:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833816.932679:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932686:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932697:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833816.932699:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833816.932703:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932709:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e77511a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932731:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932737:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932743:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932749:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833816.932752:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932758:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932766:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6451e01700) 00010000:00010000:1.0:1787833816.932768:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833816.932771:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932777:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932813:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775113 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b0d expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932826:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b0d expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833816.932842:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833816.932845:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833816.932847:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199800, rc 0) 00000100:00100000:1.0:1787833816.932970:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+38:10354:x1874679367237504:12345-192.168.202.15@tcp:101:stat.0 Request processed in 6766us (6954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833816.932977:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:3.0:1787833817.004465:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833817.004802:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367238144 00000100:00100000:2.0:1787833817.004813:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367238144 00000100:00100000:2.0:1787833817.004921:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:2.0:1787833817.004932:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+38:10360:x1874679367238144:12345-192.168.202.15@tcp:36:truncate.0 00010000:00010000:2.0:1787833817.004991:0:7195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833817.005019:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b0d expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.005038:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:2.0:1787833817.005044:0:7195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833817.005257:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.005272:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.005283:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833817.005402:0:7195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787833817.005430:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7ba505f reply state 0000000028c08b7f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833817.005447:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833817.005568:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+40:10360:x1874679367238144:12345-192.168.202.15@tcp:36:truncate.0 Request processed in 637us (1112us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787833817.005587:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00000020:00080000:2.0:1787833817.005593:0:7195:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1787833817.006037:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787833817.007777:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.007794:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.007803:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.007810:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833817.007815:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.007823:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.007842:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833817.007845:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833817.007850:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.007856:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e77512f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833817.151990:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833817.152397:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367238272 00000100:00100000:2.0:1787833817.152408:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367238272 00000100:00100000:2.0:1787833817.152905:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:2.0:1787833817.152914:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+39:10374:x1874679367238272:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:2.0:1787833817.152935:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833817.152954:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775136 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b14 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153026:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153043:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153064:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153077:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153082:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153086:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153190:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153195:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153199:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833817.153228:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787833817.153231:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833817.153253:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153262:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153269:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153276:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153283:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153289:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833817.153294:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153301:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153321:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833817.153325:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833817.153330:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153337:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e77513d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153399:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153405:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153412:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153417:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833817.153419:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153423:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153428:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6474279300) 00010000:00010000:2.0:1787833817.153430:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833817.153432:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153436:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153471:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775136 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b14 expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153483:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b14 expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.153490:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:2.0:1787833817.153492:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833817.153495:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2200, rc 0) 00000100:00100000:2.0:1787833817.153589:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+40:10374:x1874679367238272:12345-192.168.202.15@tcp:101:stat.0 Request processed in 663us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833817.153599:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:3.0:1787833817.241625:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833817.241839:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367238528 00000100:00100000:2.0:1787833817.241849:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367238528 00000100:00100000:2.0:1787833817.241901:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:2.0:1787833817.241908:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+40:10384:x1874679367238528:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833817.241928:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833817.241945:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b1b expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833817.242063:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787833817.242191:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775152 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b1b expref: 42 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.242203:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:2.0:1787833817.242205:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833817.242221:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b1b expref: 42 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.242232:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3800, rc 0) 00000100:00100000:2.0:1787833817.242292:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+41:10384:x1874679367238528:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 384us (679us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787833817.242300:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:3.0:1787833817.247882:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833817.248082:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367238784 00000100:00100000:2.0:1787833817.248093:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367238784 00000100:00100000:2.0:1787833817.248157:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:2.0:1787833817.248169:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+41:10384:x1874679367238784:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833817.248527:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+42:10384:x1874679367238784:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 359us (656us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787833817.248545:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787833817.263843:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833817.263914:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833817.264011:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833817.264118:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367239168 00000100:00100000:2.0:1787833817.264132:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367239168 00000100:00100000:2.0:1787833817.264222:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:2.0:1787833817.264236:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445620b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2345:x1874679367239168:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833817.264335:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445620b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2345:x1874679367239168:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 102us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833817.264371:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:1.0:1787833817.265016:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367239040 00000100:00100000:1.0:1787833817.265024:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367239040 00000100:00100000:1.0:1787833817.265079:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:1.0:1787833817.265089:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445621a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367239040:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833817.265139:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445621a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367239040:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 52us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833817.265145:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00080000:3.0:1787833817.266909:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833817.266917:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833817.271685:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367238912 00000100:00100000:0.0:1787833817.271701:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367238912 00000100:00100000:0.0:1787833817.271853:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 283 00000100:00100000:0.0:1787833817.271863:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2345:x1874679367238912:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833817.271958:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2345:x1874679367238912:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 96us (8042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833817.271966:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 283 00000100:00100000:2.0:1787833817.330829:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833817.331115:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367239424 00000100:00100000:3.0:1787833817.331126:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367239424 00000100:00100000:3.0:1787833817.331189:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787833817.331199:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+42:10390:x1874679367239424:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787833817.331224:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833817.331246:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775160 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b22 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.331402:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.331418:0:7195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b14 expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.331427:0:7195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.331463:0:7195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b14 expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.331477:0:7195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b14 expref: 43 pid: 5816 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833817.331491:0:7195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6445623c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375656960:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833817.331636:0:7195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787833817.336612:0:7195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6445623c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375656960:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833817.336647:0:7195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833817.338704:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833817.338983:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367239552 00000100:00100000:1.0:1787833817.339003:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367239552 00010000:00010000:1.0:1787833817.339070:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b14 expref: 44 pid: 5816 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833817.339110:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:1.0:1787833817.339121:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+44:2344:x1874679367239552:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833817.339136:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833817.339143:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b14 expref: 44 pid: 5816 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.339156:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b14 expref: 44 pid: 5816 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.339199:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77514b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b14 expref: 44 pid: 5816 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.339217:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833817.339223:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.339233:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.339241:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.339285:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833817.339380:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+43:2344:x1874679367239552:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 221us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833817.339388:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00010000:00010000:3.0:1787833817.339457:0:7195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.339465:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833817.339484:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787833817.339664:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775160 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b22 expref: 44 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.339680:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b22 expref: 43 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.339688:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:3.0:1787833817.339690:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787833817.339693:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2de00, rc 0) 00000100:00100000:3.0:1787833817.339720:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+43:10390:x1874679367239424:12345-192.168.202.15@tcp:101:bash.0 Request processed in 8523us (8905us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787833817.339727:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787833817.344452:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833817.345726:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367239808 00000100:00100000:2.0:1787833817.345739:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367239808 00000100:00100000:2.0:1787833817.345806:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:2.0:1787833817.345817:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445622580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+43:10390:x1874679367239808:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:2.0:1787833817.346120:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.346139:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833817.346151:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833817.346207:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787833817.346234:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c80db3a reply state 000000000652fa11 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833817.346244:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833817.346714:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445622580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+46:10390:x1874679367239808:12345-192.168.202.15@tcp:36:bash.0 Request processed in 895us (2268us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787833817.346722:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000020:00080000:2.0:1787833817.346727:0:5815:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787833817.355703:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.355724:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.355732:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.355738:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833817.355743:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.355772:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.355792:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833817.355795:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833817.355801:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.355808:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775175 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833817.357160:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833817.357443:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367239936 00000100:00100000:1.0:1787833817.357453:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367239936 00000100:00100000:1.0:1787833817.357512:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:1.0:1787833817.357523:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445623c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+45:10390:x1874679367239936:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787833817.357561:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833817.357593:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e77517c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b29 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.357690:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.357705:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b22 expref: 46 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.357713:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.357748:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b22 expref: 46 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.357776:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b22 expref: 46 pid: 7195 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833817.357791:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375657088:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833817.357893:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833817.364122:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833817.364314:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375657088:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833817.364375:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833817.364527:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367240064 00000100:00100000:3.0:1787833817.364544:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367240064 00010000:00010000:3.0:1787833817.364591:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b22 expref: 47 pid: 7195 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833817.364630:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:3.0:1787833817.364640:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+47:2345:x1874679367240064:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833817.364668:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833817.364676:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b22 expref: 47 pid: 7195 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.364688:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b22 expref: 47 pid: 7195 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.364710:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775167 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b22 expref: 47 pid: 7195 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.364725:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:3.0:1787833817.364729:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.364739:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.364746:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.364770:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833817.364829:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+46:2345:x1874679367240064:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 191us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833817.364837:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00010000:00010000:0.0:1787833817.364989:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.365006:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833817.365059:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787833817.365064:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833817.365089:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.365122:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e77517c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b29 expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.365138:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b29 expref: 45 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.365145:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833817.365147:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833817.365150:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199600, rc 0) 00000100:00100000:0.0:1787833817.365178:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445623c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+45:10390:x1874679367239936:12345-192.168.202.15@tcp:101:bash.0 Request processed in 7658us (8029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833817.365186:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:2.0:1787833817.369963:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833817.370125:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367240320 00000100:00100000:0.0:1787833817.370135:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367240320 00000100:00100000:0.0:1787833817.370202:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787833817.370212:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+45:10390:x1874679367240320:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:0.0:1787833817.370523:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+46:10390:x1874679367240320:12345-192.168.202.15@tcp:35:bash.0 Request processed in 312us (572us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787833817.370882:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00010000:00010000:2.0:1787833817.404685:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833817.467123:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833817.467218:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367240576 00000100:00100000:3.0:1787833817.467230:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367240576 00000100:00100000:3.0:1787833817.467301:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:3.0:1787833817.467312:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+46:10400:x1874679367240576:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833817.467382:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833817.467403:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e77518a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b30 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833817.467520:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787833817.467664:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e77518a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b30 expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.467679:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:3.0:1787833817.467683:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833817.467688:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e77518a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b30 expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.467701:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2de00, rc 0) 00000100:00100000:3.0:1787833817.468036:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+47:10400:x1874679367240576:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 726us (923us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787833817.468044:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:1.0:1787833817.474616:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833817.474692:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367240704 00000100:00100000:3.0:1787833817.474702:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367240704 00000100:00100000:3.0:1787833817.474764:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:3.0:1787833817.474773:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+47:10400:x1874679367240704:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:3.0:1787833817.474845:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.474860:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.474871:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.474897:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.474904:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.474910:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.474995:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475002:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475008:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833817.475043:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475057:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475063:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475070:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475078:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833817.475082:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475097:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475110:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:3.0:1787833817.475113:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833817.475118:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475124:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475138:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475144:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475150:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475155:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833817.475158:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475164:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475172:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b645a7d3800) 00010000:00010000:3.0:1787833817.475174:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833817.475177:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475192:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77519f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475208:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475214:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475220:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475224:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833817.475227:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475232:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475240:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:3.0:1787833817.475242:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833817.475245:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.475250:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833817.475328:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+47:10400:x1874679367240704:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 555us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833817.475335:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:2.0:1787833817.478238:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833817.478366:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367240960 00000100:00100000:0.0:1787833817.478376:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367240960 00000100:00100000:0.0:1787833817.478429:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787833817.478439:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+47:10400:x1874679367240960:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787833817.478708:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+48:10400:x1874679367240960:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 269us (479us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787833817.478861:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787833817.535207:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833817.535316:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367241216 00000100:00100000:1.0:1787833817.535328:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367241216 00000100:00100000:1.0:1787833817.535422:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:1.0:1787833817.535432:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+48:10403:x1874679367241216:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833817.535458:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833817.535480:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7751ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b37 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535570:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535592:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535604:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535642:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535651:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535658:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535794:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7751c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535804:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7751c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535811:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7751c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833817.535820:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787833817.535926:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535933:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535939:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535944:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833817.535948:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535967:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535980:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833817.535983:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833817.535988:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.535995:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536010:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536015:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536020:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536025:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833817.536027:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536033:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536040:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6451e01700) 00010000:00010000:1.0:1787833817.536042:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833817.536045:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536060:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536105:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7751ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b37 expref: 51 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536120:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7751c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b37 expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.536127:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833817.536130:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833817.536132:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198000, rc 0) 00000100:00100000:1.0:1787833817.536205:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+50:10403:x1874679367241216:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 776us (1011us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787833817.536213:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:1.0:1787833817.542021:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833817.542087:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833817.542174:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367241472 00000100:00100000:0.0:1787833817.542184:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367241472 00000100:00100000:0.0:1787833817.542259:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787833817.542269:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+50:2347:x1874679367241472:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833817.542284:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833817.542309:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7751c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b37 expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.542326:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833817.542331:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833817.542426:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+49:2347:x1874679367241472:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 158us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833817.542433:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787833817.543050:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367241344 00000100:00100000:3.0:1787833817.543057:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367241344 00000100:00100000:3.0:1787833817.543098:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:3.0:1787833817.543106:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477617c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+49:10403:x1874679367241344:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787833817.543163:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.543177:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.543187:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.543212:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.543218:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.543224:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.543230:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833817.543234:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.543242:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.543252:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:3.0:1787833817.543255:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833817.543258:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.543289:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833817.543376:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477617c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+49:10403:x1874679367241344:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 270us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833817.543384:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:1.0:1787833817.547811:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833817.547907:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367241728 00000100:00100000:0.0:1787833817.547929:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367241728 00000100:00100000:0.0:1787833817.547994:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787833817.548005:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+49:10403:x1874679367241728:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787833817.548307:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+50:10403:x1874679367241728:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 302us (507us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787833817.548315:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787833817.662363:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833817.662388:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375657216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833817.662462:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833817.662681:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375657216 00000100:00100000:1.0:1787833817.662691:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375657216 00000100:00100000:1.0:1787833817.662757:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787833817.662767:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445620f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375657216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833817.662809:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833817.662855:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445620f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375657216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833817.662862:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787833817.663095:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833817.663134:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375657216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833817.691283:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833817.691385:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367241984 00000100:00100000:1.0:1787833817.691395:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367241984 00000100:00100000:1.0:1787833817.691449:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:1.0:1787833817.691457:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+50:10421:x1874679367241984:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:1.0:1787833817.691481:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833817.691500:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.691611:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.691624:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.691634:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833817.691643:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787833817.691743:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b3e expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.691757:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b3e expref: 52 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.691763:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833817.691765:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787833817.691767:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198400, rc 0) 00000100:00100000:1.0:1787833817.691819:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+52:10421:x1874679367241984:12345-192.168.202.15@tcp:101:cat.0 Request processed in 363us (556us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787833817.691826:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:1.0:1787833817.709203:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833817.709298:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367242112 00000100:00100000:3.0:1787833817.709308:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367242112 00000100:00100000:3.0:1787833817.709398:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:3.0:1787833817.709408:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460341a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+52:10422:x1874679367242112:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833817.709434:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833817.709458:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b45 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.709526:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7751f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.709551:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7751f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.709563:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7751f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833817.709652:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787833817.709656:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833817.709678:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7751f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.709706:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7751ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b45 expref: 54 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.709724:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7751f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b45 expref: 53 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833817.709732:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:3.0:1787833817.709735:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833817.709738:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2d600, rc 0) 00000100:00100000:3.0:1787833817.709808:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460341a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+53:10422:x1874679367242112:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 402us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833817.709815:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:0.0:1787833817.717075:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833817.717640:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367242496 00000100:00100000:2.0:1787833817.717652:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367242496 00000100:00100000:2.0:1787833817.717763:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:2.0:1787833817.717773:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+53:10422:x1874679367242496:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833817.718106:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+54:10422:x1874679367242496:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 335us (1044us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787833817.718114:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:3.0:1787833817.720074:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833817.720301:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367242624 00000100:00100000:1.0:1787833817.720311:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367242624 00000100:00100000:1.0:1787833817.720529:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:1.0:1787833817.720641:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445620780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+54:10422:x1874679367242624:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:1.0:1787833817.720658:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787833817.720686:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e775183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b29 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.720708:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7751de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b3e expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.720718:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77508e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aea expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.720727:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:1.0:1787833817.720738:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833817.720787:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445620780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+51:10422:x1874679367242624:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 151us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833817.722490:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787833817.722686:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833817.722752:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367242752 00000100:00100000:1.0:1787833817.722762:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367242752 00000100:00100000:1.0:1787833817.722811:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:1.0:1787833817.722820:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+51:10422:x1874679367242752:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:1.0:1787833817.722919:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.722936:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833817.722961:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787833817.723257:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833817.723525:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787833817.723944:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787833817.724195:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+51:10422:x1874679367242752:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 1372us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833817.724206:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:3.0:1787833817.752333:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833817.752467:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367242880 00000100:00100000:0.0:1787833817.752478:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367242880 00000100:00100000:0.0:1787833817.752543:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:0.0:1787833817.752553:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+51:10424:x1874679367242880:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833817.752580:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833817.752599:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775201 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b4c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752668:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752682:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752693:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752707:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752714:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752720:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752822:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752831:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752838:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833817.752870:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787833817.752875:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833817.752891:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752902:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752910:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752916:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752922:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752928:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833817.752932:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752939:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752958:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:0.0:1787833817.752961:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833817.752977:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752983:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.752996:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.753003:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.753009:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.753014:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833817.753017:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.753022:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.753029:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b646021dd00) 00010000:00010000:0.0:1787833817.753032:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833817.753034:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.753041:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77520f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.753082:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775201 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b4c expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.753095:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b4c expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833817.753102:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:0.0:1787833817.753104:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833817.753107:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e000, rc 0) 00000100:00100000:0.0:1787833817.753173:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+52:10424:x1874679367242880:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 621us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833817.753180:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00010000:00010000:2.0:1787833818.429586:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787833818.648002:0:11981:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833818.648015:0:11981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787833818.648058:0:11981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787833818.648065:0:11981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787833818.685277:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833818.685290:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833818.685364:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787833818.685373:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833818.685560:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460344780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375657344:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787833818.685714:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833818.714731:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.717596:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460344780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375657344:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787833818.717803:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367243008 00000100:00100000:3.0:1787833818.717810:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367243008 00000100:00100000:3.0:1787833818.717860:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:3.0:1787833818.717870:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460345a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:320cb14b-678a-483a-8914-ee446104f369+52:10435:x1874679367243008:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787833818.728423:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460345a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:320cb14b-678a-483a-8914-ee446104f369+52:10435:x1874679367243008:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 Request processed in 10540us (13688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.728438:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:0.0:1787833818.732794:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.733024:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367243136 00000100:00100000:3.0:1787833818.733035:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367243136 00000100:00100000:3.0:1787833818.733099:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:3.0:1787833818.733110:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+52:10435:x1874679367243136:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787833818.733143:0:5816:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787833818.733259:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+52:10435:x1874679367243136:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 151us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.733266:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:0.0:1787833818.750044:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.750426:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367243264 00000100:00100000:3.0:1787833818.750436:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367243264 00000100:00100000:3.0:1787833818.750488:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:3.0:1787833818.750497:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+52:10435:x1874679367243264:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787833818.752119:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.752143:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.752156:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.752181:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.752190:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.752197:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.752229:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.752239:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.752246:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833818.754080:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787833818.754092:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833818.754113:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754130:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754137:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754144:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754162:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833818.754166:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754174:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754189:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:3.0:1787833818.754192:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833818.754198:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754203:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77521d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754215:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754219:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754224:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754229:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833818.754232:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754238:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754255:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b645a7d3800) 00010000:00010000:3.0:1787833818.754258:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833818.754261:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.754267:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775224 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.755112:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.755122:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.755128:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.755133:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833818.755137:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.755143:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.755152:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:3.0:1787833818.755155:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833818.755158:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.755164:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77522b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833818.766696:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+52:10435:x1874679367243264:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 16189us (16650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.766711:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:3.0:1787833818.766917:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.766941:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367243520 00000100:00100000:3.0:1787833818.766949:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367243520 00000100:00100000:3.0:1787833818.766984:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:3.0:1787833818.766991:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460344780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+52:10435:x1874679367243520:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833818.767011:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833818.767028:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775232 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b53 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767119:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767135:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767147:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833818.767157:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787833818.767325:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767335:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767372:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767384:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833818.767389:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767396:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767408:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:3.0:1787833818.767411:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833818.767415:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767421:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775239 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767455:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775232 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b53 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767464:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:3.0:1787833818.767467:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833818.767470:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775232 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b53 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.767478:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c400, rc 0) 00000100:00100000:3.0:1787833818.767524:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460344780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+53:10435:x1874679367243520:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 534us (608us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787833818.767531:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:3.0:1787833818.770222:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.770286:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367243648 00000100:00100000:3.0:1787833818.770296:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367243648 00000100:00100000:3.0:1787833818.770379:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:3.0:1787833818.770392:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460344b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+53:10435:x1874679367243648:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787833818.770435:0:5817:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787833818.770554:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460344b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+53:10435:x1874679367243648:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 165us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.770571:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:3.0:1787833818.775624:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833818.776640:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367243904 00000100:00100000:1.0:1787833818.776656:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367243904 00000100:00100000:1.0:1787833818.776726:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:1.0:1787833818.776739:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460347c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+53:10435:x1874679367243904:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833818.776767:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833818.776771:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787833818.776800:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7751f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b45 expref: 53 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.776820:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833818.776826:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833818.776840:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775247 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b5a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787833818.777866:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787833818.778137:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77524e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.778152:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.778173:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.778237:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775247 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b5a expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.778255:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77524e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b5a expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.778263:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6451e01500) 00010000:00010000:1.0:1787833818.778266:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833818.778269:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198800, rc 0) 00000100:00100000:1.0:1787833818.778816:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460347c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+54:10435:x1874679367243904:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2076us (3200us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787833818.778826:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00000001:00080000:0.0:1787833818.783702:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:0.0:1787833818.783727:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787833818.789421:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.789477:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367244160 00000100:00100000:3.0:1787833818.789489:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367244160 00000100:00100000:3.0:1787833818.789550:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:3.0:1787833818.789568:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460346580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+49:10435:x1874679367244160:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787833818.789632:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833818.789662:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77524e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b5a expref: 49 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.789684:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6451e01500) 00010000:00010000:3.0:1787833818.789694:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833818.789719:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.789733:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.789744:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.789816:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.789824:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.789831:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790125:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790134:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790141:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790147:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833818.790151:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790159:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790169:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:3.0:1787833818.790172:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833818.790176:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790182:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e77525c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790198:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790203:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790208:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790214:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833818.790217:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790223:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790231:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x531b2b51 (ffff9b645a7d3800) 00010000:00010000:3.0:1787833818.790234:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833818.790237:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.790242:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775263 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x531b2b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833818.790334:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460346580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+48:10435:x1874679367244160:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 774us (928us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787833818.790362:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:2.0:1787833818.791694:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787833818.791715:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375657472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787833818.791776:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833818.791844:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375657472 00000100:00100000:2.0:1787833818.791851:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375657472 00000100:00100000:2.0:1787833818.791922:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787833818.791932:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1874679375657472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787833818.792454:0:6660:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787833818.792620:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a902dd7, atime: 0x6a902dd8, ctime: 0x6a902dd7, blocks: 0x1 00010000:00010000:2.0:1787833818.792631:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.792648:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=297s v=(0 0) 00010000:00010000:2.0:1787833818.792653:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833818.792659:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.792675:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.792684:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.792698:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.792719:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787833818.793293:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375657472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1344us (1498us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787833818.793303:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787833818.793358:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833818.793365:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.793373:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833818.793378:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.793387:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.793404:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.793412:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e77526a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.793430:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833818.793438:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833818.793440:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787833818.793492:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b64772db840/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787833818.793499:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375657472:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1787833818.793762:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833818.793813:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.793842:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367244288 00000100:00100000:3.0:1787833818.793854:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367244288 00000100:00100000:3.0:1787833818.793896:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:3.0:1787833818.793904:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460346940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+48:10435:x1874679367244288:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833818.793922:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833818.793939:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775271 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b61 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.793976:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.793988:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.793998:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.794084:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775271 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b61 expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.794100:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b61 expref: 49 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.794108:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833818.794111:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787833818.794113:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c400, rc 0) 00000100:00100000:3.0:1787833818.794157:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460346940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+49:10435:x1874679367244288:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 254us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.794164:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 74 00000020:00080000:0.0:1787833818.795967:0:5838:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b64457c0240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787833818.795976:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6446bc4900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b64457c0cc0 00000020:00080000:0.0:1787833818.795979:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6446bc4f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6450793000 00000001:00080000:0.0:1787833818.796004:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:0.0:1787833818.796020:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:3.0:1787833818.796137:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787833818.796251:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787833818.800818:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.800900:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367244544 00000100:00100000:3.0:1787833818.800914:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367244544 00000100:00100000:3.0:1787833818.801017:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:3.0:1787833818.801032:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+13:10435:x1874679367244544:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787833818.801160:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.801179:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.801192:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833818.801683:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787833818.801695:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 297557354350ns, next at 298557351612ns, rc = 0 00000004:00010000:3.0:1787833818.801784:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d225891a reply state 00000000cce86ab8 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833818.801794:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833818.801900:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+15:10435:x1874679367244544:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 871us (1097us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787833818.801907:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:1.0:1787833818.810733:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.810998:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367244672 00000100:00100000:3.0:1787833818.811010:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367244672 00000100:00100000:3.0:1787833818.811076:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:3.0:1787833818.811087:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460343c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+15:10435:x1874679367244672:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833818.811114:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833818.811137:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b68 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.811213:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b68 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.811229:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b68 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833818.811248:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833818.811252:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833818.811255:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c600, rc 0) 00000100:00100000:3.0:1787833818.811327:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460343c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+16:10435:x1874679367244672:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 242us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.811335:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00010000:00010000:2.0:1787833818.813404:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.813421:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.813429:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.813435:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833818.813439:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.813447:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.813461:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:2.0:1787833818.813464:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787833818.813478:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.813485:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e77527f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833818.816677:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.816716:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367244800 00000100:00100000:3.0:1787833818.816726:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367244800 00000100:00100000:3.0:1787833818.816766:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:3.0:1787833818.816775:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2343:x1874679367244800:12345-192.168.202.15@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787833818.816809:0:8382:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:3.0:1787833818.816840:0:8382:0:(genops.c:1385:class_connect()) connect: client 320cb14b-678a-483a-8914-ee446104f369, cookie 0x2bdb54ee5e77528d 00002000:00100000:3.0:1787833818.816854:0:8382:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 320cb14b-678a-483a-8914-ee446104f369/ffff9b647f899000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787833818.816866:0:8382:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1787833818.817128:0:8382:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787833818.817158:0:8382:0:(import.c:65:import_set_state_nolock()) ffff9b647f89f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833818.817235:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+6:2343:x1874679367244800:12345-192.168.202.15@tcp:8:lhsmtool_posix.0 Request processed in 459us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.817253:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:3.0:1787833818.820902:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833818.821425:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367244928 00000100:00100000:2.0:1787833818.821438:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367244928 00000100:00100000:2.0:1787833818.821532:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787833818.821549:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+6:0:x1874679367244928:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787833818.821912:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787833818.888846:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1787833818.888872:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000100:00100000:2.0:1787833818.889156:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:0:x1874679367244928:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 67603us (68257us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787833818.889167:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787833818.901362:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833818.901828:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367245184 00000100:00100000:0.0:1787833818.901839:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367245184 00000100:00100000:0.0:1787833818.901904:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787833818.901915:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+15:10435:x1874679367245184:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787833818.903639:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+16:10435:x1874679367245184:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1717us (2292us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787833818.903652:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:1.0:1787833818.914659:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833818.914751:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367245440 00000100:00100000:2.0:1787833818.914761:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367245440 00000100:00100000:2.0:1787833818.914821:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:2.0:1787833818.914832:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460342580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+16:10435:x1874679367245440:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787833818.914935:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460342580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+16:10435:x1874679367245440:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 105us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833818.914943:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:3.0:1787833818.920355:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833818.920447:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367245568 00000100:00100000:1.0:1787833818.920459:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367245568 00000100:00100000:1.0:1787833818.920533:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:1.0:1787833818.920544:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460345680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+16:10435:x1874679367245568:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833818.920574:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833818.920599:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775294 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b6f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.920673:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e77529b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.920697:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e77529b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.920710:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e77529b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833818.920752:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833818.920773:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e77529b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.920800:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775294 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b6f expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.920820:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e77529b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b6f expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.920829:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:1.0:1787833818.920833:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787833818.920836:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199800, rc 0) 00000100:00100000:1.0:1787833818.920902:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460345680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+17:10435:x1874679367245568:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 360us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833818.920910:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:2.0:1787833818.929073:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833818.929146:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367245696 00000100:00100000:1.0:1787833818.929156:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367245696 00000100:00100000:1.0:1787833818.929213:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:1.0:1787833818.929224:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367245696:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833818.929243:0:8382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833818.929275:0:8382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b76 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787833818.929302:0:8382:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902dda, blocks: 0x1 00010000:00010000:1.0:1787833818.929321:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=297s v=(0 0) 00010000:00010000:1.0:1787833818.929326:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833818.929334:0:8382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b76 expref: 6 pid: 8382 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.929386:0:8382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b76 expref: 6 pid: 8382 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.929400:0:8382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198c00, rc 0) 00000100:00100000:1.0:1787833818.929463:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367245696:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 241us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833818.930028:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:1.0:1787833818.934300:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833818.934663:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367245952 00000100:00100000:3.0:1787833818.934674:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367245952 00000100:00100000:3.0:1787833818.934764:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:3.0:1787833818.934775:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460342940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+17:10435:x1874679367245952:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787833818.934886:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460342940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+17:10435:x1874679367245952:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 114us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.934894:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:0.0:1787833818.939002:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833818.939233:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367246080 00000100:00100000:2.0:1787833818.939244:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367246080 00000100:00100000:2.0:1787833818.939332:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:2.0:1787833818.939361:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+6:10435:x1874679367246080:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833818.939380:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833818.939401:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b7d expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.939432:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b76 expref: 7 pid: 8382 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.939441:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833818.939458:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833818.939476:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.939514:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b76 expref: 7 pid: 8382 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.939845:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b76 expref: 7 pid: 8382 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833818.939863:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6661:1874679375657600:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833818.940721:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444c6db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833818.964013:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833818.964722:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367246208 00000100:00100000:1.0:1787833818.964734:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367246208 00010000:00010000:1.0:1787833818.964783:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b76 expref: 8 pid: 8382 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833818.964825:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787833818.964835:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446009850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367246208:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833818.964851:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833818.964874:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b76 expref: 8 pid: 8382 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.964902:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b76 expref: 8 pid: 8382 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.964928:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833818.964933:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833818.964940:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.964952:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833818.965005:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833818.965019:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603403c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1874679375657728:192.168.202.15@tcp:105: 00000100:00100000:1.0:1787833818.965102:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787833818.967510:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603403c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1874679375657728:192.168.202.15@tcp:105: 00010000:00010000:3.0:1787833818.967546:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833818.967602:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446009850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367246208:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 2768us (3601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.967613:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00010000:00010000:2.0:1787833818.968948:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e83a895/0x2bdb54ee5e7752a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b76 expref: 7 pid: 8382 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833818.969071:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6661:1874679375657600:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833818.969101:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 6 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833818.969117:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3200, rc 0) 00000100:00100000:3.0:1787833818.969287:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+6:10435:x1874679367246080:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 29945us (30297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833818.969296:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:1.0:1787833818.975428:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833818.975821:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367246336 00000100:00100000:2.0:1787833818.975832:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367246336 00002000:00100000:2.0:1787833818.975879:0:6666:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b64603430c0 x1874679367246336/t0(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:624/0 lens 504/0 e 0 to 0 dl 1787833829 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787833818.975892:0:6666:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b64603430c0 with x1874679367246336 ext(0->8) 00002000:00010000:2.0:1787833818.975911:0:6666:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b64603430c0 00000100:00100000:2.0:1787833818.976095:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787833818.976106:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367246336:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787833818.976860:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603430c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367246336:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 752us (1440us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787833818.976870:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00002000:00100000:2.0:1787833818.976879:0:6666:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b64603430c0 x1874679367246336/t4294967302(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:624/0 lens 504/448 e 0 to 0 dl 1787833829 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787833818.976889:0:6666:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b64603430c0 with x1874679367246336 ext(0->8) 00002000:00010000:2.0:1787833818.976894:0:6666:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b64603430c0 00000100:00100000:0.0:1787833818.980296:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833818.980443:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367246464 00000100:00100000:1.0:1787833818.980455:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367246464 00000100:00100000:1.0:1787833818.980537:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:1.0:1787833818.980549:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+17:10435:x1874679367246464:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787833819.029091:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787833819.029115:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787833819.029127:0:5838:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787833819.029149:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787833819.029161:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787833819.029364:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+13:10435:x1874679367246464:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 48790us (49051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833819.029376:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:3.0:1787833819.031532:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833819.031555:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460341680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375657856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787833819.031628:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833819.033247:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375657856 00000100:00100000:0.0:1787833819.033262:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375657856 00000100:00100000:0.0:1787833819.033388:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787833819.033399:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460344f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375657856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787833819.033622:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787833819.033626:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787833819 00002000:00010000:0.0:1787833819.033628:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787833819.033631:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787833818 -> 1787833819 00002000:00010000:0.0:1787833819.033633:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787833819.033723:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460344f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874679375657856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 326us (2095us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787833819.033742:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787833819.034117:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6460341680/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787833819.034126:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460341680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375657856:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1787833819.034196:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833819.035976:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833819.036121:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367246592 00000100:00100000:2.0:1787833819.036130:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367246592 00000100:00100000:2.0:1787833819.036190:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:2.0:1787833819.036201:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367246592:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787833819.077091:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1787833819.077113:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787833819.077487:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367246592:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 41281us (41515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833819.077500:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:0.0:1787833819.081638:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833819.081740:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367246848 00000100:00100000:2.0:1787833819.081751:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367246848 00000100:00100000:2.0:1787833819.081828:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:2.0:1787833819.081839:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+13:10435:x1874679367246848:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787833819.081894:0:7195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833819.081922:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e77529b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b6f expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.081973:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:2.0:1787833819.081979:0:7195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833819.082011:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.082026:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.082037:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833819.082714:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000358228d2 reply state 00000000264b8ebf transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833819.082727:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833819.082844:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+14:10435:x1874679367246848:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 1005us (1377us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787833819.082853:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00080000:3.0:1787833819.082936:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833819.085881:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:2.0:1787833819.086251:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.086263:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.086282:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.086289:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833819.086294:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.086316:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.086333:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:2.0:1787833819.086337:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833819.086375:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.086382:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833819.086550:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367246976 00000100:00100000:3.0:1787833819.086569:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367246976 00000100:00100000:3.0:1787833819.086619:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:3.0:1787833819.086629:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367246976:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787833819.086866:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787833819.086871:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787833819 -> 1787833817 00002000:00010000:3.0:1787833819.086873:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787833816 00002000:00010000:3.0:1787833819.086876:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787833819 -> 1787833817 00002000:00010000:3.0:1787833819.086877:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787833819.086947:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367246976:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 319us (1075us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787833819.086964:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:0.0:1787833819.089554:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833819.089806:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367247232 00000100:00100000:3.0:1787833819.089818:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367247232 00000100:00100000:3.0:1787833819.089881:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:3.0:1787833819.089891:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+13:10435:x1874679367247232:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787833819.089975:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.089994:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b61 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.090003:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.090036:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b61 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.090062:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b61 expref: 13 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833819.090078:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375657984:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833819.090178:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772eaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787833819.092931:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375657984:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833819.092969:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833819.095079:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833819.095706:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367247360 00000100:00100000:1.0:1787833819.095732:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367247360 00010000:00010000:1.0:1787833819.095775:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b61 expref: 14 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833819.095817:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:1.0:1787833819.095827:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+14:2344:x1874679367247360:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833819.095847:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833819.095854:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b61 expref: 14 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.095867:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b61 expref: 14 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.095890:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775278 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b61 expref: 14 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.095907:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:1.0:1787833819.095912:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.095920:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.095927:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.095971:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833819.096031:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+13:2344:x1874679367247360:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 205us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833819.096048:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00010000:00010000:2.0:1787833819.097165:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.097179:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.097210:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.097217:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.097224:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.097230:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833819.097235:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.097241:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.097276:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:2.0:1787833819.097279:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787833819.097284:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.097290:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833819.097381:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+12:10435:x1874679367247232:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 7488us (7833us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787833819.097390:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:0.0:1787833819.101170:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833819.101264:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367247488 00000100:00100000:3.0:1787833819.101284:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367247488 00000100:00100000:3.0:1787833819.101382:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:3.0:1787833819.101394:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477729a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367247488:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787833819.101442:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.101474:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.101484:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833819.101489:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833819.101493:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.101854:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.101878:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 7 pid: 6661 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833819.101892:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6661:1874679375658112:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833819.101974:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772eaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833819.105837:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833819.105909:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367247616 00000100:00100000:1.0:1787833819.105918:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367247616 00010000:00010000:1.0:1787833819.105970:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 8 pid: 6661 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833819.106015:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787833819.106025:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477728b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367247616:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833819.106042:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833819.106066:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 8 pid: 6661 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.106080:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 8 pid: 6661 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.106106:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833819.106112:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833819.106117:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.106128:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.106150:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833819.106211:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477728b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367247616:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 187us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833819.106236:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00010000:00010000:3.0:1787833819.106989:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e7752a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b7d expref: 7 pid: 6661 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833819.107005:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6661:1874679375658112:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833819.107025:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.107036:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.107043:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.107071:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.107079:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.107101:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.107109:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833819.107113:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.107122:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.107136:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.107143:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e7752be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833819.107207:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477729a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367247488:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 5816us (6048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833819.107215:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:0.0:1787833819.111183:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833819.111285:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367247872 00000100:00100000:3.0:1787833819.111296:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367247872 00000100:00100000:3.0:1787833819.111385:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:3.0:1787833819.111395:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+12:10435:x1874679367247872:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787833819.111485:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.111515:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.111842:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.112096:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.112108:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b68 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.112117:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.112151:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b68 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.112168:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b68 expref: 13 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833819.112184:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375658240:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833819.112285:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444c6d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787833819.116264:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833819.116411:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367248000 00000100:00100000:3.0:1787833819.116423:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367248000 00010000:00010000:3.0:1787833819.116470:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b68 expref: 14 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833819.116515:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:3.0:1787833819.116537:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+14:2345:x1874679367248000:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833819.116553:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833819.116569:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b68 expref: 14 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.116582:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b68 expref: 14 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.116608:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833819.116613:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.116623:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.116630:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.116665:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833819.116727:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+14:2345:x1874679367248000:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 191us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833819.116736:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00010000:00010000:2.0:1787833819.117693:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775286 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b68 expref: 13 pid: 5815 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833819.117714:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375658240:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833819.117734:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.117744:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.117751:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833819.118512:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787833819.118871:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787833819.118915:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787833819.119437:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5817:1874679375658368:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787833819.119682:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833819.119714:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64431e70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833819.119788:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375658368 00000100:00100000:0.0:1787833819.119796:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375658368 00000100:00100000:0.0:1787833819.119853:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833819.119863:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1874679375658368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787833819.119953:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1874679375658368:12345-0@lo:1000:mdt00_002.0 Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833819.119970:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833819.120111:0:5817:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787833819.120117:0:5817:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6460341680, transno 4294967303 00000100:00100000:3.0:1787833819.120138:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5817:1874679375658368:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787833819.121251:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787833819.122259:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647772a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5817:1874679375658496:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787833819.122715:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833819.122785:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6479dea180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833819.122826:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375658496 00000100:00100000:2.0:1787833819.122833:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375658496 00000100:00100000:2.0:1787833819.122920:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833819.122929:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64777283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1874679375658496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787833819.123230:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64777283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5817:x1874679375658496:12345-0@lo:1000:mdt00_002.0 Request processed in 301us (515us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787833819.123238:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833819.123315:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647772a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5817:1874679375658496:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787833819.123370:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123382:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123390:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123396:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833819.123400:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123409:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123423:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:1.0:1787833819.123427:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833819.123431:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123437:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7752cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123483:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123490:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123509:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123514:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833819.123770:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123777:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123786:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:1.0:1787833819.123789:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833819.123792:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123798:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7751fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123819:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123832:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b4c expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123841:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123873:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b4c expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.123897:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b4c expref: 16 pid: 5817 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833819.123912:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460341680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375658624:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833819.123991:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833819.126451:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460341680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375658624:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833819.126490:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833819.128570:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833819.128638:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367248128 00000100:00100000:2.0:1787833819.128649:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367248128 00010000:00010000:2.0:1787833819.128708:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b4c expref: 17 pid: 5817 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833819.128768:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:2.0:1787833819.128778:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+17:2344:x1874679367248128:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833819.128795:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833819.128802:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b4c expref: 17 pid: 5817 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.128815:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b4c expref: 17 pid: 5817 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.128838:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b4c expref: 17 pid: 5817 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.128856:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:2.0:1787833819.128862:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.128871:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.128879:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.128911:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833819.128969:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+16:2344:x1874679367248128:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 192us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833819.128977:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00010000:00010000:1.0:1787833819.128995:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129004:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129017:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129023:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129029:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129034:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833819.129039:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129046:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129062:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:1.0:1787833819.129065:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833819.129069:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129075:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7752d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129085:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129091:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129097:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129101:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833819.129104:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129110:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129117:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:1.0:1787833819.129119:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787833819.129122:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833819.129128:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7752c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833819.129378:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+15:10435:x1874679367247872:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 17984us (18208us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787833819.129387:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00000020:00080000:1.0:1787833819.129391:0:5817:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787833819.130069:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833819.130075:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833819.130102:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787833819.130107:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787833819.133318:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833819.134097:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367248384 00000100:00100000:2.0:1787833819.134128:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367248384 00000100:00100000:2.0:1787833819.134238:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:2.0:1787833819.134249:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477729680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+15:10435:x1874679367248384:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787833819.136239:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787833819.136773:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787833819.136850:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.136867:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.136879:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.136887:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.136894:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.136911:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833819.137041:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787833819.137155:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477729680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+17:10435:x1874679367248384:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 2904us (3845us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787833819.137165:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000020:00080000:3.0:1787833819.137171:0:5819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787833819.139783:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833819.139799:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.139811:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833819.139815:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.139824:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.139842:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833819.139845:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787833819.139851:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.139858:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7752da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833819.139880:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833819.139882:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833819.139883:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833819.452620:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787833820.164879:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833820.164890:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833820.164928:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787833820.164934:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833820.221267:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460347840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375658880:0@lo:400:kworker.0 00000100:00100000:1.0:1787833820.221376:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833820.221644:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833820.221653:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375658752:0@lo:400:kworker.0 00000100:00100000:1.0:1787833820.221686:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833820.221725:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375658880 00000100:00100000:1.0:1787833820.221732:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375658880 00000100:00100000:1.0:1787833820.221783:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787833820.221792:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460341680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375658880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833820.221846:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460341680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375658880:12345-0@lo:400:kworker.0 Request processed in 54us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833820.221853:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787833820.221875:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375658752 00000100:00100000:1.0:1787833820.221880:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375658752 00000100:00100000:1.0:1787833820.221905:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787833820.221911:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3283:x1874679375658752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833820.221940:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3283:x1874679375658752:12345-0@lo:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833820.222372:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787833820.222568:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375659008:0@lo:400:kworker.0 00000100:00100000:3.0:1787833820.222606:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833820.222631:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833820.222637:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375659136:0@lo:400:kworker.0 00000100:00100000:3.0:1787833820.222662:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833820.222691:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375659008 00000100:00100000:3.0:1787833820.222696:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375659008 00000100:00100000:3.0:1787833820.222736:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787833820.222744:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375659008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833820.222782:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375659008:12345-0@lo:400:kworker.0 Request processed in 39us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833820.222788:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787833820.222807:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375659136 00000100:00100000:3.0:1787833820.222810:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375659136 00000100:00100000:3.0:1787833820.222831:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787833820.222837:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874679375659136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833820.222867:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1874679375659136:12345-0@lo:400:kworker.0 Request processed in 29us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833820.222883:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787833820.222900:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833820.222930:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375659136:0@lo:400:kworker.0 00000100:00100000:3.0:1787833820.222940:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375659008:0@lo:400:kworker.0 00000100:00100000:1.0:1787833820.223330:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375659392:0@lo:400:kworker.0 00000100:00100000:0.0:1787833820.223576:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375659264:0@lo:400:kworker.0 00000100:00100000:0.0:1787833820.223615:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833820.224009:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833820.224058:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b866019b-748d-45d1-b7c8-b21ed54e15f4:3283:1874679375658752:0@lo:400:kworker.0 00000100:00100000:1.0:1787833820.224072:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460347840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375658880:0@lo:400:kworker.0 00000100:00100000:0.0:1787833820.224381:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375659392 00000100:00100000:0.0:1787833820.224387:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375659392 00000100:00080000:1.0:1787833820.224617:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833820.224844:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787833820.224855:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460340f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375659392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833820.224928:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460340f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375659392:12345-0@lo:400:kworker.0 Request processed in 75us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833820.224935:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787833820.225050:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375659392:0@lo:400:kworker.0 00000100:00100000:3.0:1787833820.225730:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375659264 00000100:00100000:3.0:1787833820.225737:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375659264 00000100:00100000:3.0:1787833820.225793:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787833820.225802:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477728f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375659264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833820.225866:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477728f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375659264:12345-0@lo:400:kworker.0 Request processed in 65us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833820.225872:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787833820.226086:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375659264:0@lo:400:kworker.0 00000100:00080000:1.0:1787833820.226474:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787833820.477831:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833820.733681:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833820.733707:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375659520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833820.733783:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833820.733923:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375659520 00000100:00100000:1.0:1787833820.733931:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375659520 00000100:00100000:1.0:1787833820.733983:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787833820.733993:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460343840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375659520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833820.734027:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833820.734075:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460343840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375659520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833820.734083:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787833820.734132:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603421c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375659520:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787833820.816193:0:12032:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833820.816204:0:12032:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787833820.816239:0:12032:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787833820.816245:0:12032:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833821.015462:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.015500:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367248640 00000100:00100000:1.0:1787833821.015509:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367248640 00000100:00100000:1.0:1787833821.015584:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:1.0:1787833821.015593:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+17:10453:x1874679367248640:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833821.015627:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833821.015648:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7752e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.015923:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7752e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.015940:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7752e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.015952:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7752e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833821.015964:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787833821.016139:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7752e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b84 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.016160:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7752e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b84 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.016168:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833821.016171:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833821.016175:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199600, rc 0) 00000100:00100000:1.0:1787833821.016240:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+19:10453:x1874679367248640:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 649us (788us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787833821.016248:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00080000:1.0:1787833821.016274:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833821.030110:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833821.030417:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367248768 00000100:00100000:2.0:1787833821.030430:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367248768 00000100:00100000:2.0:1787833821.030506:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:2.0:1787833821.030517:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+19:10453:x1874679367248768:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787833821.030620:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.030638:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.030649:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.030663:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.030670:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.030676:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033614:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033637:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033650:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833821.033700:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033713:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033743:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033750:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033756:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833821.033760:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033767:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033779:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833821.033782:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833821.033786:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033792:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7752f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033807:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033813:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033818:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033822:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833821.033830:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033836:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033844:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6474279100) 00010000:00010000:2.0:1787833821.033846:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833821.033849:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033855:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7752fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033870:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033876:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033882:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033886:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833821.033889:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033894:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033901:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6474279400) 00010000:00010000:2.0:1787833821.033903:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833821.033912:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.033918:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833821.034021:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+19:10453:x1874679367248768:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 3501us (3915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833821.034032:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:0.0:1787833821.097159:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.097240:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367249024 00000100:00100000:1.0:1787833821.097251:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367249024 00000100:00100000:1.0:1787833821.097332:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:1.0:1787833821.097392:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+19:10456:x1874679367249024:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833821.097416:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833821.097438:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e77530b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b8b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.097515:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.097531:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.097554:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.097573:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.097580:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.097586:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.097897:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.097905:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.097912:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833821.097931:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787833821.098034:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098042:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098049:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098055:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833821.098059:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098067:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098079:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833821.098082:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833821.098086:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098092:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098103:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098110:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098125:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098130:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833821.098133:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098139:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098147:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6451e01700) 00010000:00010000:1.0:1787833821.098149:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833821.098152:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098157:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098196:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e77530b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b8b expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098209:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b8b expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.098217:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:1.0:1787833821.098218:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833821.098221:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199a00, rc 0) 00000100:00100000:1.0:1787833821.098283:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+21:10456:x1874679367249024:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 942us (1133us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787833821.098300:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:0.0:1787833821.106075:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833821.106298:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367249152 00000100:00100000:3.0:1787833821.106308:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367249152 00000100:00100000:3.0:1787833821.106407:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:3.0:1787833821.106418:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+21:10456:x1874679367249152:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787833821.106511:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.106528:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.106565:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.106596:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.106622:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.106628:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.106635:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833821.106640:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.106647:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.106660:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:3.0:1787833821.106663:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833821.106668:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.106674:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77532e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833821.106749:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+21:10456:x1874679367249152:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 333us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.106757:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:2.0:1787833821.114045:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.114147:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367249408 00000100:00100000:0.0:1787833821.114156:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367249408 00000100:00100000:0.0:1787833821.114243:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787833821.114254:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+21:10456:x1874679367249408:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787833821.114591:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+22:10456:x1874679367249408:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 339us (556us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787833821.114600:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787833821.156483:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.156594:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367249664 00000100:00100000:1.0:1787833821.156605:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367249664 00000100:00100000:1.0:1787833821.156668:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:1.0:1787833821.156678:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477729680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+22:9978:x1874679367249664:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787833821.156704:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833821.156724:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775335 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b92 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.156851:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.156866:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b8b expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.156875:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.156907:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b8b expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.156920:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b8b expref: 23 pid: 5816 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833821.156935:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460342d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375659648:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833821.157031:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833821.159952:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460342d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375659648:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833821.160002:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.169377:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.169489:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367249792 00000100:00100000:1.0:1787833821.169509:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367249792 00010000:00010000:1.0:1787833821.169563:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b8b expref: 24 pid: 5816 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833821.169607:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787833821.169618:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64777292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+24:2345:x1874679367249792:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833821.169634:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833821.169640:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b8b expref: 24 pid: 5816 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.169653:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b8b expref: 24 pid: 5816 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.169675:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b8b expref: 24 pid: 5816 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.169693:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:1.0:1787833821.169699:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.169707:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.169715:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.169781:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833821.169838:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64777292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+23:2345:x1874679367249792:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 221us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833821.169846:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00010000:00010000:2.0:1787833821.171635:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.171651:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833821.171678:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787833821.171874:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775335 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b92 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.171895:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b92 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.171904:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:2.0:1787833821.171907:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787833821.171911:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198000, rc 0) 00000100:00100000:2.0:1787833821.171969:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477729680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+23:9978:x1874679367249664:12345-192.168.202.15@tcp:101:bash.0 Request processed in 15292us (15497us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787833821.171978:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:2.0:1787833821.190043:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833821.190136:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367250048 00000100:00100000:3.0:1787833821.190145:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367250048 00000100:00100000:3.0:1787833821.190205:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:3.0:1787833821.190214:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+23:9978:x1874679367250048:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:3.0:1787833821.190525:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.190560:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.190681:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833821.190740:0:7195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787833821.190838:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017b8ff17 reply state 000000000aaea82f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833821.190848:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787833821.190898:0:7195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787833821.191053:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+27:9978:x1874679367250048:12345-192.168.202.15@tcp:36:bash.0 Request processed in 837us (1019us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787833821.191061:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 89 00000020:00080000:3.0:1787833821.191066:0:7195:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787833821.195810:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.195855:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.195863:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.195870:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833821.195874:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.195882:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.195901:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:0.0:1787833821.195904:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833821.195909:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.195915:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e77534a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833821.196549:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.196773:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367250176 00000100:00100000:1.0:1787833821.196788:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367250176 00000100:00100000:1.0:1787833821.196859:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:1.0:1787833821.196869:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+26:9978:x1874679367250176:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787833821.196893:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833821.196910:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775351 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3b99 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.197091:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775351 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b99 expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.197116:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775351 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b99 expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.197142:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:1.0:1787833821.197145:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833821.197148:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199a00, rc 0) 00000100:00100000:1.0:1787833821.197205:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+27:9978:x1874679367250176:12345-192.168.202.15@tcp:101:bash.0 Request processed in 338us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833821.197217:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:2.0:1787833821.200573:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833821.200702:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367250304 00000100:00100000:3.0:1787833821.200712:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367250304 00000100:00100000:3.0:1787833821.200793:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:3.0:1787833821.200803:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:9978:x1874679367250304:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787833821.200820:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833821.200842:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ba0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833821.200870:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a902dd9, atime: 0x6a902dd8, ctime: 0x6a902dd9, blocks: 0xb 00010000:00010000:3.0:1787833821.200892:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=299s v=(0 0) 00010000:00010000:3.0:1787833821.200897:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833821.200905:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba0 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.200953:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba0 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.200967:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c000, rc 0) 00000100:00100000:3.0:1787833821.201035:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:9978:x1874679367250304:12345-192.168.202.15@tcp:101:bash.0 Request processed in 233us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.201043:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00080000:1.0:1787833821.201720:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833821.204386:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833821.204503:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367250432 00000100:00100000:2.0:1787833821.204513:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367250432 00002000:00010000:2.0:1787833821.204562:0:6664:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787833821.204567:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b647772b480 with x1874679367250432 ext(0->18446744073709551615) 00002000:00010000:2.0:1787833821.204579:0:6664:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b647772b480. 00000100:00100000:2.0:1787833821.204606:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:2.0:1787833821.204617:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367250432:12345-192.168.202.15@tcp:10:bash.0 00002000:00010000:2.0:1787833821.204922:0:6664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787833821.204925:0:6664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787833817 -> 1787833821 00002000:00010000:2.0:1787833821.204928:0:6664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787833816 -> 1787833816 00002000:00010000:2.0:1787833821.204930:0:6664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787833817 -> 1787833821 00002000:00010000:2.0:1787833821.204932:0:6664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787833821.205014:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367250432:12345-192.168.202.15@tcp:10:bash.0 Request processed in 399us (638us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787833821.205023:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00002000:00010000:2.0:1787833821.205027:0:6664:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787833821.205030:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b647772b480 with x1874679367250432 ext(0->18446744073709551615) 00002000:00010000:2.0:1787833821.205034:0:6664:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b647772b480. 00000100:00100000:0.0:1787833821.307247:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833821.307320:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367250560 00000100:00100000:3.0:1787833821.307330:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367250560 00000100:00100000:3.0:1787833821.307471:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:3.0:1787833821.307479:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+27:10470:x1874679367250560:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:3.0:1787833821.307559:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.307580:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.307595:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.307611:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.307619:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.312162:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314249:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314269:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314280:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833821.314331:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314369:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314379:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314393:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314399:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833821.314404:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314411:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314425:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:3.0:1787833821.314428:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833821.314432:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314445:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77535f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314458:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314464:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314469:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314473:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833821.314476:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314481:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314489:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b645a7d3300) 00010000:00010000:3.0:1787833821.314491:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833821.314494:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314511:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314526:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314531:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314553:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314559:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833821.314562:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314568:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314580:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:3.0:1787833821.314584:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833821.314587:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.314595:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77536d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833821.314810:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+27:10470:x1874679367250560:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 7205us (7444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.314822:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000001:00080000:3.0:1787833821.336049:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1787833821.336066:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1787833821.351654:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833821.352007:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367250816 00000100:00100000:2.0:1787833821.352017:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367250816 00000100:00100000:2.0:1787833821.352078:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:2.0:1787833821.352088:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477729e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+27:10473:x1874679367250816:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833821.352110:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833821.352129:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775374 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ba7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.352224:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.352239:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.352252:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.352587:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.352598:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.352606:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.353172:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.353182:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.353189:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833821.353199:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787833821.354046:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354058:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354075:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354079:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833821.354082:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354087:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354098:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833821.354100:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833821.354103:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354108:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e77537b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354117:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354121:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354124:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354127:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833821.354129:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354142:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354149:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6474279400) 00010000:00010000:2.0:1787833821.354152:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833821.354155:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354161:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354205:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775374 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba7 expref: 30 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354215:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba7 expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.354220:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:2.0:1787833821.354221:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787833821.354223:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2800, rc 0) 00000100:00100000:2.0:1787833821.354327:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477729e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+29:10473:x1874679367250816:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 2240us (2684us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787833821.354333:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:3.0:1787833821.356788:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.357236:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367250944 00000100:00100000:0.0:1787833821.357247:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367250944 00000100:00100000:0.0:1787833821.359101:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:0.0:1787833821.359119:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460345e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+29:10473:x1874679367250944:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:0.0:1787833821.359193:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.359223:0:7195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b92 expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.359231:0:7195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.359262:0:7195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b92 expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.359284:0:7195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b92 expref: 29 pid: 5816 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.359300:0:7195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477728780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375659776:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833821.359431:0:7195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444c6d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787833821.361654:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.361761:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367251200 00000100:00100000:1.0:1787833821.361782:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367251200 00000100:00100000:1.0:1787833821.361842:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:1.0:1787833821.361855:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+30:5587:x1874679367251200:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787833821.362234:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+31:5587:x1874679367251200:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 384us (586us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787833821.362240:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787833821.364939:0:7195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477728780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375659776:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833821.364975:0:7195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833821.367708:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.367823:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367251328 00000100:00100000:1.0:1787833821.367832:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367251328 00010000:00010000:1.0:1787833821.367875:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b92 expref: 31 pid: 5816 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833821.367915:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:1.0:1787833821.367924:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477431680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+31:2345:x1874679367251328:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833821.367949:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833821.367955:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b92 expref: 31 pid: 5816 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.367965:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b92 expref: 31 pid: 5816 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.367982:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77533c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b92 expref: 31 pid: 5816 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.367995:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:1.0:1787833821.367999:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.368020:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.368026:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.368049:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833821.368096:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477431680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+30:2345:x1874679367251328:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 173us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833821.368107:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00010000:00010000:0.0:1787833821.368261:0:7195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.368447:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.368473:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.368477:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.368482:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.368494:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833821.368502:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.368508:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.368515:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:0.0:1787833821.368517:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787833821.368519:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.368523:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e775397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.368584:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460345e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+29:10473:x1874679367250944:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 9472us (11803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833821.368592:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:2.0:1787833821.371097:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.371140:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367251584 00000100:00100000:0.0:1787833821.371150:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367251584 00000100:00100000:0.0:1787833821.371241:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:0.0:1787833821.371249:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+29:10473:x1874679367251584:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787833821.371594:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+30:10473:x1874679367251584:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 344us (502us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787833821.371602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787833821.458212:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.458412:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367251840 00000100:00100000:1.0:1787833821.458421:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367251840 00000100:00100000:1.0:1787833821.458485:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:1.0:1787833821.458496:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+30:10485:x1874679367251840:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:1.0:1787833821.458528:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833821.458559:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77539e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bae expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.458632:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.458646:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.458658:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.458670:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.458698:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.458706:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459035:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7753b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459045:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7753b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459053:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7753b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833821.459063:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787833821.459156:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459164:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459171:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459177:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833821.459181:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459188:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459210:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833821.459213:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833821.459217:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459223:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459235:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459241:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459246:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459251:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833821.459253:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459260:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459878:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6451e01900) 00010000:00010000:1.0:1787833821.459884:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833821.459889:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459897:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459971:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e77539e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bae expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459986:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7753b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bae expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.459993:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:1.0:1787833821.459994:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833821.459996:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198600, rc 0) 00000100:00100000:1.0:1787833821.460067:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+32:10485:x1874679367251840:12345-192.168.202.15@tcp:101:cat.0 Request processed in 1572us (1865us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787833821.460074:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:2.0:1787833821.466997:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.467329:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367252096 00000100:00100000:1.0:1787833821.467353:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367252096 00000100:00100000:1.0:1787833821.467412:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:1.0:1787833821.467421:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+32:10485:x1874679367252096:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:1.0:1787833821.467909:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+33:10485:x1874679367252096:12345-192.168.202.15@tcp:35:cat.0 Request processed in 486us (920us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787833821.467918:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:0.0:1787833821.490326:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833821.490627:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367252352 00000100:00100000:3.0:1787833821.490652:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367252352 00000100:00100000:3.0:1787833821.490712:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:3.0:1787833821.490723:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+33:10486:x1874679367252352:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:3.0:1787833821.490787:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787833821.490816:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7753b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bae expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.490840:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba7 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.490853:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775351 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b99 expref: 31 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.490862:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:3.0:1787833821.490873:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833821.490894:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.490907:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.490916:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.490928:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.490935:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.490954:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.491278:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.491287:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.491294:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833821.492986:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787833821.492999:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300248658314ns, next at 301248655572ns, rc = 0 00010000:00010000:3.0:1787833821.493072:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493087:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493097:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493104:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493110:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493115:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493136:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833821.493158:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493173:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493179:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493184:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833821.493188:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493195:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493207:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833821.493210:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787833821.493215:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493220:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7753cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493237:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493243:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493248:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493253:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833821.493262:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493286:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493295:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:3.0:1787833821.493297:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833821.493299:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.493304:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7753c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833821.493315:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb871f90 reply state 00000000fd12d636 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833821.493323:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833821.494177:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+32:10486:x1874679367252352:12345-192.168.202.15@tcp:36:rm.0 Request processed in 3447us (3851us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787833821.494187:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 95 00010000:00010000:0.0:1787833821.494293:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833821.494301:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.494319:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833821.494322:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.494330:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.494366:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:0.0:1787833821.494369:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787833821.494373:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.494388:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7753d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.494408:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833821.494411:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833821.494413:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833821.497204:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.497223:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.497230:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.497254:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833821.497259:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.497279:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.497299:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b645a7d3300) 00010000:00010000:1.0:1787833821.497303:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833821.497307:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.497313:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7753c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.500677:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833821.549433:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.550069:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367252608 00000100:00100000:1.0:1787833821.550081:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367252608 00000100:00100000:1.0:1787833821.550148:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:1.0:1787833821.550159:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460347840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+31:10492:x1874679367252608:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787833821.550185:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833821.550206:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bb5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.550469:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.550485:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.550618:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.550633:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.550640:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.550647:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787833821.551850:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787833821.552289:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552305:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552317:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552382:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552390:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552396:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552402:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833821.552415:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552423:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552436:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833821.552439:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833821.552444:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552450:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7753e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833821.552464:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2d18d13 reply state 00000000ac3fa8c0 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833821.552473:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787833821.552516:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e7753dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bb5 expref: 34 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552531:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bb5 expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.552548:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:1.0:1787833821.552550:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833821.552553:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199000, rc 0) 00000100:00100000:1.0:1787833821.552647:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460347840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+34:10492:x1874679367252608:12345-192.168.202.15@tcp:101:bash.0 Request processed in 2488us (3224us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787833821.552656:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 96 00010000:00010000:0.0:1787833821.556953:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.556973:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.556979:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.556985:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833821.556990:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.557017:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.557035:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6451e01900) 00010000:00010000:0.0:1787833821.557038:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833821.557044:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.557049:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7753eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833821.558121:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.559859:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367252736 00000100:00100000:0.0:1787833821.559876:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367252736 00000100:00100000:0.0:1787833821.560066:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:0.0:1787833821.560076:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:2344:x1874679367252736:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787833821.560096:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833821.560118:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bbc expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833821.560149:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833821.560172:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1787833821.560178:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833821.560189:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bbc expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.560208:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bbc expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.560242:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751fe00, rc 0) 00000100:00100000:0.0:1787833821.560577:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367252736:12345-192.168.202.15@tcp:101:bash.0 Request processed in 501us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833821.560586:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:2.0:1787833821.564569:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833821.564789:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367252864 00000100:00100000:3.0:1787833821.564799:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367252864 00000100:00100000:3.0:1787833821.564863:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:3.0:1787833821.564873:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477432d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:10492:x1874679367252864:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787833821.564895:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833821.564920:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bc3 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.564980:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bbc expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.564990:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833821.564994:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833821.564999:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.565031:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bbc expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.565043:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bbc expref: 7 pid: 6660 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833821.565057:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1874679375659904:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833821.565150:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea3c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787833821.567777:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833821.568715:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833821.568865:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1874679375659904:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833821.568905:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.568928:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2ca00, rc 0) 00000100:00100000:3.0:1787833821.569003:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477432d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:10492:x1874679367252864:12345-192.168.202.15@tcp:101:bash.0 Request processed in 4131us (4444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.569013:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:0.0:1787833821.569371:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367252992 00000100:00100000:0.0:1787833821.569378:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367252992 00010000:00010000:0.0:1787833821.569413:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bbc expref: 7 pid: 6660 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.569452:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787833821.569462:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446008c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367252992:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833821.569477:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833821.569500:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bbc expref: 7 pid: 6660 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.569514:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bbc expref: 7 pid: 6660 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.569548:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775400 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bbc expref: 7 pid: 6660 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.569562:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833821.569567:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833821.569574:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.569591:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.569639:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.569653:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772d9a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1874679375660032:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787833821.569723:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444c6d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787833821.574407:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772d9a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1874679375660032:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787833821.574434:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833821.574489:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446008c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367252992:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 5028us (5782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833821.574511:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:3.0:1787833821.577855:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.578061:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367253248 00000100:00100000:0.0:1787833821.578070:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367253248 00000100:00100000:0.0:1787833821.578132:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787833821.578142:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+33:10492:x1874679367253248:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:0.0:1787833821.578641:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+34:10492:x1874679367253248:12345-192.168.202.15@tcp:35:bash.0 Request processed in 499us (795us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787833821.578649:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:2.0:1787833821.810605:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.810760:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367253376 00000100:00100000:0.0:1787833821.810770:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367253376 00000100:00100000:0.0:1787833821.810845:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:0.0:1787833821.810856:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+34:10508:x1874679367253376:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833821.810891:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833821.810911:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77540e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bca expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.810986:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775415 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.811002:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.811012:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833821.811072:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787833821.811076:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833821.811099:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.811125:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77540e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bca expref: 36 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.811144:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bca expref: 35 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.811151:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:0.0:1787833821.811154:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833821.811158:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f600, rc 0) 00000100:00100000:0.0:1787833821.811228:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+35:10508:x1874679367253376:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 374us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833821.811236:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:2.0:1787833821.815306:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.815520:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367253632 00000100:00100000:1.0:1787833821.815531:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367253632 00000100:00100000:1.0:1787833821.815601:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:1.0:1787833821.815611:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+35:10508:x1874679367253632:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833821.815632:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833821.815654:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e77541c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bd1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.815755:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.815770:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.815782:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833821.815792:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787833821.816117:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e77541c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bd1 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.816138:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bd1 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.816148:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:1.0:1787833821.816151:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833821.816155:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198800, rc 0) 00000100:00100000:1.0:1787833821.816227:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+37:10508:x1874679367253632:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 617us (930us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787833821.816250:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:2.0:1787833821.823312:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833821.823780:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367253760 00000100:00100000:3.0:1787833821.823794:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367253760 00000100:00100000:3.0:1787833821.823888:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787833821.823899:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+37:2344:x1874679367253760:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833821.823916:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833821.823953:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bd1 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833821.823973:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:3.0:1787833821.823978:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833821.824039:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+36:2344:x1874679367253760:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 142us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833821.824047:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787833821.827207:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.827302:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367254016 00000100:00100000:0.0:1787833821.827312:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367254016 00000100:00100000:0.0:1787833821.827409:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:0.0:1787833821.827419:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+36:10508:x1874679367254016:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833821.827442:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833821.827461:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775431 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bd8 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.827575:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775438 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.827591:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.827602:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833821.827614:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787833821.827730:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775431 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bd8 expref: 39 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.827749:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bd8 expref: 38 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.827756:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:0.0:1787833821.827759:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787833821.827762:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751ee00, rc 0) 00000100:00100000:0.0:1787833821.827827:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+38:10508:x1874679367254016:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 409us (630us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787833821.827852:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:2.0:1787833821.834203:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.834299:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367254144 00000100:00100000:0.0:1787833821.834310:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367254144 00000100:00100000:0.0:1787833821.834396:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:0.0:1787833821.834406:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646effa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367254144:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:0.0:1787833821.834457:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.834479:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.834489:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833821.834621:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833821.834627:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.834667:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.834682:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 6 pid: 6659 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.834698:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772d9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1874679375660160:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833821.835110:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b645dd08d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833821.838481:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772d9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1874679375660160:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833821.838529:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833821.840562:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.841113:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367254272 00000100:00100000:0.0:1787833821.841123:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367254272 00002000:00100000:0.0:1787833821.841176:0:6666:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b6477431e00 x1874679367254272/t0(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:627/0 lens 504/0 e 0 to 0 dl 1787833832 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833821.841187:0:6666:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6477431e00 with x1874679367254272 ext(0->8) 00010000:00010000:0.0:1787833821.841195:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 7 pid: 6659 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.841210:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 7 pid: 6659 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833821.841218:0:6666:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b6477431e00 00000100:00100000:0.0:1787833821.841251:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:0.0:1787833821.841261:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477431e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367254272:12345-192.168.202.15@tcp:4:lfs.0 00000100:00100000:0.0:1787833821.842281:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477431e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:320cb14b-678a-483a-8914-ee446104f369+9:2344:x1874679367254272:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 1015us (1723us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787833821.842292:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00002000:00100000:0.0:1787833821.842302:0:6666:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b6477431e00 x1874679367254272/t4294967302(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:627/0 lens 504/448 e 0 to 0 dl 1787833832 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833821.842311:0:6666:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6477431e00 with x1874679367254272 ext(0->8) 00010000:00010000:0.0:1787833821.842318:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 9 pid: 6659 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.842378:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 9 pid: 6659 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833821.842387:0:6666:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b6477431e00 00000100:00100000:2.0:1787833821.846597:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.846695:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367254400 00000100:00100000:0.0:1787833821.846705:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367254400 00010000:00010000:0.0:1787833821.846818:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 9 pid: 6659 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.847085:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:0.0:1787833821.847096:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477430780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2344:x1874679367254400:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833821.847114:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787833821.847136:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787833821.847139:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787833821 00002000:00010000:0.0:1787833821.847142:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787833821 00002000:00010000:0.0:1787833821.847144:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787833821 00010000:00010000:0.0:1787833821.847150:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 9 pid: 6659 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.847165:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 9 pid: 6659 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.847189:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775407 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bc3 expref: 9 pid: 6659 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.847229:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833821.847234:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833821.847240:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.847251:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.847383:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833821.847447:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477430780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367254400:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 353us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833821.847455:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00010000:00010000:2.0:1787833821.849123:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.849144:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.849184:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.849192:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.849201:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.849209:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fe00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833821.849214:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.849246:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.849264:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.849425:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775446 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833821.849655:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646effa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367254144:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 15245us (15457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833821.849665:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787833821.853925:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.854000:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367254656 00000100:00100000:0.0:1787833821.854010:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367254656 00000100:00100000:0.0:1787833821.854075:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:0.0:1787833821.854086:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f11850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+38:10508:x1874679367254656:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:0.0:1787833821.854149:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bd8 expref: 38 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833821.854482:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787833821.854554:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787833821.854871:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787833821.854922:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.854939:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bb5 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.854957:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.854990:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bb5 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.855007:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bb5 expref: 42 pid: 5817 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.855022:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772d9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874679375660288:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833821.855110:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833821.858281:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772d9a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874679375660288:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833821.858315:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.865148:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.865408:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367254784 00000100:00100000:1.0:1787833821.865419:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367254784 00010000:00010000:1.0:1787833821.865463:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bb5 expref: 43 pid: 5817 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833821.865556:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:1.0:1787833821.865567:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+43:2344:x1874679367254784:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833821.865583:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833821.865590:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bb5 expref: 43 pid: 5817 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.865603:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bb5 expref: 43 pid: 5817 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.865626:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7753f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bb5 expref: 43 pid: 5817 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.865641:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:1.0:1787833821.865646:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.865654:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.865661:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.865711:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833821.865932:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+42:2344:x1874679367254784:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 366us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833821.865940:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00010000:00010000:0.0:1787833821.866384:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.866392:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833821.866522:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787833821.866733:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787833821.866871:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772da1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874679375660416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833821.866969:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833821.867001:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b645dd08d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787833821.867754:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375660416 00000100:00100000:1.0:1787833821.867764:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375660416 00000100:00100000:1.0:1787833821.867813:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833821.867822:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874679375660416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787833821.868115:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874679375660416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 294us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833821.868123:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833821.868489:0:5818:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787833821.868506:0:5818:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787833821.868527:0:5818:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b64772db840, transno 4294967301 00000100:00100000:3.0:1787833821.868553:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772da1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874679375660416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787833821.869099:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787833821.869179:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603443c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874679375660544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787833821.869229:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833821.869253:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833821.870157:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375660544 00000100:00100000:0.0:1787833821.870167:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375660544 00000100:00100000:0.0:1787833821.870207:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787833821.870216:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5818:x1874679375660544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833821.872315:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1874679375660544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 2092us (3078us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787833821.872328:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833821.872633:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603443c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874679375660544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787833821.872813:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1787833821.873101:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.873112:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.873120:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.873126:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833821.873131:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.873138:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.873172:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:2.0:1787833821.873175:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787833821.873182:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833821.873187:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77544d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787833821.873422:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787833821.873625:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1787833821.873636:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 300629294836ns, next at 301629292890ns, rc = 0 00000001:00080000:2.0:1787833821.873642:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1787833821.873673:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01700) 00010000:00010000:2.0:1787833821.873676:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787833821.873684:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775438 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bd8 expref: 46 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833821.874128:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f11850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+45:10508:x1874679367254656:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 20042us (20212us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1787833821.874137:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000020:00080000:2.0:1787833821.874142:0:5818:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787833821.877586:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.877782:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367254912 00000100:00100000:1.0:1787833821.877791:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367254912 00000100:00100000:1.0:1787833821.877865:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:1.0:1787833821.877876:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+45:10508:x1874679367254912:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833821.877899:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833821.877923:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775454 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bdf expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.877996:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775454 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bdf expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.878011:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775454 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bdf expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833821.878027:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:1.0:1787833821.878043:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833821.878049:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199200, rc 0) 00000100:00100000:1.0:1787833821.878114:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+46:10508:x1874679367254912:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 239us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833821.878121:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:2.0:1787833821.882554:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833821.882649:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367255168 00000100:00100000:1.0:1787833821.882660:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367255168 00000100:00100000:1.0:1787833821.882722:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:1.0:1787833821.882732:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+46:10508:x1874679367255168:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787833821.882998:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+47:10508:x1874679367255168:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 267us (464us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787833821.883006:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:3.0:1787833821.971231:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833821.971383:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367255296 00000100:00100000:0.0:1787833821.971394:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367255296 00000100:00100000:0.0:1787833821.971455:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:0.0:1787833821.971465:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460344f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+47:10518:x1874679367255296:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:0.0:1787833821.971565:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.971584:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.971598:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.971613:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.971621:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.971627:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.971736:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.971758:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.971765:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833821.971807:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.971820:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972170:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972181:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972188:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ea00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833821.972192:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972201:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972212:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:0.0:1787833821.972215:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833821.972220:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972227:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77545b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972249:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972256:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972261:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972266:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833821.972268:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972274:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972281:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b646021d900) 00010000:00010000:0.0:1787833821.972284:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833821.972287:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972293:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972322:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972329:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972334:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972405:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833821.972409:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972415:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972425:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:0.0:1787833821.972428:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833821.972431:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833821.972437:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833821.972654:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460344f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+47:10518:x1874679367255296:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1187us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833821.972662:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:0.0:1787833822.017400:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833822.017622:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367255552 00000100:00100000:1.0:1787833822.017632:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367255552 00000100:00100000:1.0:1787833822.017695:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:1.0:1787833822.017705:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+47:10521:x1874679367255552:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833822.017727:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833822.017749:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775470 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3be6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.017823:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.017847:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.017859:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.017893:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.017901:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.017907:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018163:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018173:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018181:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833822.018191:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787833822.018286:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018293:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018300:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018306:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833822.018311:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018332:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018457:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833822.018462:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833822.018467:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018474:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018488:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018654:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018660:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018664:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833822.018667:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018673:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018681:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6451e01200) 00010000:00010000:1.0:1787833822.018684:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833822.018686:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018702:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77547e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018745:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775470 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3be6 expref: 50 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018758:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3be6 expref: 49 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.018765:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:1.0:1787833822.018768:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833822.018770:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198c00, rc 0) 00000100:00100000:1.0:1787833822.019010:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+49:10521:x1874679367255552:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1305us (1668us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787833822.019019:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:2.0:1787833822.023233:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833822.023722:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367255680 00000100:00100000:3.0:1787833822.023749:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367255680 00000100:00100000:3.0:1787833822.023798:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:3.0:1787833822.023807:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+49:10521:x1874679367255680:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787833822.024172:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.024191:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.024204:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.024232:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.024239:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.024246:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.024252:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833822.024256:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.024263:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.024276:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:3.0:1787833822.024280:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833822.024284:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.024301:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833822.024692:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477433840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+49:10521:x1874679367255680:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 883us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833822.024701:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:3.0:1787833822.027742:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833822.028117:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367255936 00000100:00100000:1.0:1787833822.028130:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367255936 00000100:00100000:1.0:1787833822.028200:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:1.0:1787833822.028211:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+49:10521:x1874679367255936:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787833822.028712:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+50:10521:x1874679367255936:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 501us (985us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787833822.028721:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:1.0:1787833822.137729:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833822.137962:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367256192 00000100:00100000:2.0:1787833822.137972:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367256192 00000100:00100000:2.0:1787833822.138033:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:2.0:1787833822.138044:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460342d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+50:10531:x1874679367256192:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787833822.138069:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833822.138085:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787833822.138112:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775415 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bca expref: 50 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.138133:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833822.138138:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833822.138153:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77549a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.138455:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7754a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.138469:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7754a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.138479:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7754a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833822.138680:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787833822.138816:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e77549a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bed expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.139280:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7754a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bed expref: 51 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.139290:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833822.139293:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833822.139296:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3400, rc 0) 00000100:00100000:2.0:1787833822.139394:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460342d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+51:10531:x1874679367256192:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1352us (1674us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787833822.139414:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:2.0:1787833822.143757:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833822.143839:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367256448 00000100:00100000:3.0:1787833822.143850:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367256448 00000100:00100000:3.0:1787833822.143909:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 105 00000100:00100000:3.0:1787833822.143920:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+51:10531:x1874679367256448:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:3.0:1787833822.143978:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787833822.144005:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7754a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bed expref: 51 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.144025:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3be6 expref: 50 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.144035:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:3.0:1787833822.144039:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833822.144262:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.144283:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.144293:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833822.144416:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787833822.144442:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bcf5c9c reply state 00000000e71cfd2a transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833822.144452:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833822.144558:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+52:10531:x1874679367256448:12345-192.168.202.15@tcp:36:bash.0 Request processed in 639us (809us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787833822.144565:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 105 00000020:00080000:3.0:1787833822.144571:0:5815:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787833822.148563:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833822.148718:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367256576 00000100:00100000:3.0:1787833822.148729:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367256576 00000100:00100000:3.0:1787833822.148787:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:3.0:1787833822.148798:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477432d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+52:10531:x1874679367256576:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787833822.148822:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833822.148851:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7754b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bf4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.148943:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.148957:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.148965:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.148983:0:5817:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.149012:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.149933:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.149946:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.149963:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.149969:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833822.149973:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.149981:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.149996:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:1.0:1787833822.150000:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833822.150003:0:3266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.150010:0:3266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.150017:0:3266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.150083:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833822.150090:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7754af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.150226:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.150234:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833822.150323:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787833822.150328:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833822.150589:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.150622:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7754b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bf4 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.150636:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bf4 expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.150644:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:3.0:1787833822.150646:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833822.150649:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2ca00, rc 0) 00000100:00100000:3.0:1787833822.150746:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477432d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+52:10531:x1874679367256576:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1949us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833822.150755:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:2.0:1787833822.154100:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833822.154327:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367256832 00000100:00100000:0.0:1787833822.166043:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367256832 00000100:00100000:0.0:1787833822.166176:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:0.0:1787833822.166189:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+52:10531:x1874679367256832:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:0.0:1787833822.166447:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+53:10531:x1874679367256832:12345-192.168.202.15@tcp:35:bash.0 Request processed in 261us (12358us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787833822.166455:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787833822.251772:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833822.251919:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367256960 00000100:00100000:3.0:1787833822.251938:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367256960 00000100:00100000:3.0:1787833822.252003:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:3.0:1787833822.252028:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+53:10537:x1874679367256960:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833822.252055:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833822.252075:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7754c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3bfb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.252135:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7754cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.252149:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7754cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.252173:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7754cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833822.252231:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787833822.252235:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833822.252259:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7754cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.252282:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7754c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bfb expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.252300:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7754cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bfb expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.252308:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:3.0:1787833822.252310:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833822.252314:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c400, rc 0) 00000100:00100000:3.0:1787833822.252405:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+54:10537:x1874679367256960:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 378us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833822.252421:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:0.0:1787833822.257601:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833822.257813:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367257088 00000100:00100000:2.0:1787833822.257830:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367257088 00000100:00100000:2.0:1787833822.257918:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 108 00000100:00100000:2.0:1787833822.257939:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+54:10537:x1874679367257088:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833822.257959:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833822.257978:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e7754d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c02 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258038:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258051:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258062:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258077:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258083:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258088:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258215:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258224:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258231:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833822.258265:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787833822.258270:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833822.258288:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258300:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258308:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258314:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258320:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258326:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833822.258330:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258373:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258392:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833822.258395:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833822.258400:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258406:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2c00/0x2bdb54ee5e7754d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258419:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258424:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258429:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258434:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833822.258436:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258442:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258448:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6474279400) 00010000:00010000:2.0:1787833822.258450:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833822.258453:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258459:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7754e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258511:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e7754d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258523:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.258538:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833822.258540:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833822.258543:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2a00, rc 0) 00000100:00100000:2.0:1787833822.258605:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+55:10537:x1874679367257088:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 678us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833822.258612:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 108 00000100:00100000:0.0:1787833822.266679:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833822.266848:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833822.267023:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367257472 00000100:00100000:2.0:1787833822.267033:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367257472 00000100:00100000:2.0:1787833822.267091:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 109 00000100:00100000:2.0:1787833822.267101:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+55:10537:x1874679367257472:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833822.267124:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833822.267144:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7754ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c09 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.267256:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.267284:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bf4 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.267293:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.267309:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.267364:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.267377:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 56 pid: 5816 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833822.267390:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477430b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375660672:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833822.267537:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bf4 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.267547:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bf4 expref: 56 pid: 5817 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833822.267556:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477433c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375660800:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833822.267579:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64457c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833822.271650:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367257216 00000100:00100000:3.0:1787833822.271668:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367257216 00010000:00010000:2.0:1787833822.271872:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 57 pid: 5816 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833822.271921:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:2.0:1787833822.271942:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+57:2345:x1874679367257216:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833822.271960:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833822.271968:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 57 pid: 5816 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.271999:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 57 pid: 5816 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.272027:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833822.272032:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.272042:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.272048:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833822.272133:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+57:2345:x1874679367257216:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 194us (5465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833822.272141:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00010000:00010000:2.0:1787833822.274997:0:5815:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.15@tcp) returned -22 from blocking AST (req@00000000c792d558 x1874679375660672) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 56 pid: 5816 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.275020:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7754e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c02 expref: 56 pid: 5816 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833822.275034:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477430b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375660672:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833822.275047:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477433c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375660800:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833822.275066:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833822.275071:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.275097:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.275106:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833822.278129:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833822.278627:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367257600 00000100:00100000:2.0:1787833822.278638:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367257600 00010000:00010000:2.0:1787833822.278681:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bf4 expref: 56 pid: 5817 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833822.278761:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:2.0:1787833822.278772:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460343480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+56:2345:x1874679367257600:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833822.278790:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833822.278798:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bf4 expref: 56 pid: 5817 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.278819:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bf4 expref: 56 pid: 5817 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.278849:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7754bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bf4 expref: 56 pid: 5817 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.278865:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833822.278870:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.278880:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.278896:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.278929:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833822.278987:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460343480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+55:2345:x1874679367257600:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 218us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833822.278995:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00010000:00010000:0.0:1787833822.279048:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833822.279056:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833822.279075:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787833822.279214:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e7754ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c09 expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833822.279228:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c09 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833822.279236:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:0.0:1787833822.279239:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787833822.279241:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3c00, rc 0) 00000100:00100000:0.0:1787833822.279264:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+55:10537:x1874679367257472:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 12166us (12417us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787833822.279271:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 109 00000100:00100000:0.0:1787833822.283298:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833822.283562:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367257856 00000100:00100000:2.0:1787833822.283572:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367257856 00000100:00100000:2.0:1787833822.283674:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787833822.283686:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+55:10537:x1874679367257856:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:2.0:1787833822.283704:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833822.283732:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775454 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bdf expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833822.283751:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833822.283757:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833822.283836:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+54:10537:x1874679367257856:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 153us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833822.283843:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787833822.286501:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833822.286682:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367257984 00000100:00100000:3.0:1787833822.286692:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367257984 00000100:00100000:3.0:1787833822.286754:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:3.0:1787833822.286764:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+54:10537:x1874679367257984:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:3.0:1787833822.287109:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.287125:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833822.287136:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833822.287325:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787833822.287436:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+54:10537:x1874679367257984:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 673us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833822.287444:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:1.0:1787833822.290834:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833822.291021:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367258112 00000100:00100000:0.0:1787833822.291031:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367258112 00000100:00100000:0.0:1787833822.291095:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:0.0:1787833822.291105:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460341e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+54:10537:x1874679367258112:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833822.291126:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833822.291144:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77550a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c10 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833822.291213:0:7195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833822.291223:0:7195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77550a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c10 expref: 55 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833822.291241:0:7195:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833822.291254:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77550a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c10 expref: 55 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833822.291267:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:0.0:1787833822.291271:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833822.291275:0:7195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77550a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c10 expref: 55 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833822.291282:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751ea00, rc 0) 00000100:00100000:0.0:1787833822.291371:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460341e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+55:10537:x1874679367258112:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 267us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833822.291378:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:0.0:1787833822.383102:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833822.383175:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833822.383222:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833822.383244:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367258624 00000100:00100000:0.0:1787833822.383250:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833822.383253:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367258624 00000100:00100000:0.0:1787833822.383287:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833822.383305:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367258496 00000100:00100000:2.0:1787833822.383308:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367258496 00000100:00100000:2.0:1787833822.383328:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:2.0:1787833822.383367:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367258624:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833822.383375:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367258368 00000100:00100000:1.0:1787833822.383379:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367258368 00000100:00100000:1.0:1787833822.383406:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367258752 00000100:00100000:1.0:1787833822.383408:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367258752 00000100:00080000:1.0:1787833822.383425:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833822.383438:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:2.0:1787833822.383439:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367258624:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833822.383445:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+55:2344:x1874679367258368:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833822.383508:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367258240 00000100:00100000:3.0:1787833822.383512:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367258240 00000100:00100000:3.0:1787833822.383555:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 285 00000100:00100000:3.0:1787833822.383562:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367258240:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833822.383590:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367258240:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833822.383597:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 285 00000100:00100000:1.0:1787833822.385829:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+55:2344:x1874679367258368:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 2361us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833822.385844:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:1.0:1787833822.385910:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:1.0:1787833822.385931:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367258752:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833822.385970:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367258752:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 53us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833822.385977:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:0.0:1787833822.389652:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:2.0:1787833822.389708:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:0.0:1787833822.389893:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367258496:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833822.390102:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367258496:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 219us (6849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833822.390110:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00010000:00010000:3.0:1787833822.527655:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787833822.780642:0:6770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301536299363ns, next at 302536296672ns, rc = 0 00000100:00100000:2.0:1787833822.780752:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460340f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375660928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833822.780826:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833822.780959:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375660928 00000100:00100000:1.0:1787833822.780968:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375660928 00000100:00100000:1.0:1787833822.781034:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787833822.781045:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477433c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874679375660928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833822.781079:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833822.781128:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477433c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1874679375660928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833822.781136:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787833822.781411:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833822.781452:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460340f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375660928:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787833823.229612:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833823.229622:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833823.229681:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787833823.229689:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833823.229808:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603403c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375661056:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787833823.230250:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787833823.241104:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603403c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375661056:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787833823.251048:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833823.251313:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367258880 00000100:00100000:1.0:1787833823.251328:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367258880 00000100:00100000:1.0:1787833823.251674:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:1.0:1787833823.251689:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+55:10538:x1874679367258880:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787833823.251748:0:7195:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787833823.251906:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+55:10538:x1874679367258880:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 221us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833823.251924:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00080000:2.0:1787833823.252441:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833823.258518:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833823.258630:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367259008 00000100:00100000:2.0:1787833823.258653:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367259008 00000100:00100000:2.0:1787833823.258735:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:2.0:1787833823.258747:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460340b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+55:10538:x1874679367259008:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787833823.258857:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.258878:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.258894:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259126:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259152:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259165:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259199:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259224:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259233:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833823.259278:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787833823.259284:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833823.259300:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259311:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259318:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259324:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259330:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833823.259334:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259404:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259419:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:2.0:1787833823.259422:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833823.259427:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259444:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775511 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259460:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259466:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259472:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259477:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833823.259481:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259487:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259494:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b6474279400) 00010000:00010000:2.0:1787833823.259497:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833823.259511:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259517:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775518 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259539:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259545:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259557:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259563:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833823.259566:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259572:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.259581:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833823.259584:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833823.259587:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.260686:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e77551f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833823.260802:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460340b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+55:10538:x1874679367259008:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 2052us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833823.261200:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:0.0:1787833823.264171:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.264267:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367259264 00000100:00100000:3.0:1787833823.264278:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367259264 00000100:00100000:3.0:1787833823.264332:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:3.0:1787833823.264374:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+55:10538:x1874679367259264:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833823.264398:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833823.264418:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775526 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c17 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.265425:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.265447:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.265460:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833823.265473:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787833823.266219:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.266231:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.266238:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.266244:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833823.266249:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.266258:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.266273:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:0.0:1787833823.266276:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787833823.266281:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.266286:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e77552d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.266334:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775526 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c17 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.266661:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:0.0:1787833823.266664:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787833823.266669:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775526 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c17 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.266680:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2de00, rc 0) 00000100:00100000:0.0:1787833823.266832:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+56:10538:x1874679367259264:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2490us (2671us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787833823.266842:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:2.0:1787833823.278862:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.281016:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367259392 00000100:00100000:3.0:1787833823.281031:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367259392 00000100:00100000:3.0:1787833823.281166:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:3.0:1787833823.281178:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+56:10538:x1874679367259392:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787833823.281220:0:5817:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787833823.281327:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477430b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+56:10538:x1874679367259392:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 152us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833823.281337:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:1.0:1787833823.287213:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.291735:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367259648 00000100:00100000:0.0:1787833823.291753:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367259648 00000100:00100000:0.0:1787833823.291840:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:0.0:1787833823.291853:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+56:10538:x1874679367259648:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833823.291873:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833823.291877:0:7195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787833823.291904:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7754cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3bfb expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.291928:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:0.0:1787833823.291934:0:7195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833823.291950:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77553b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c1e expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787833823.292461:0:7195:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787833823.292866:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.292896:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.292907:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.292964:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77553b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c1e expref: 58 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.292982:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c1e expref: 57 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.292991:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021d900) 00010000:00010000:0.0:1787833823.292993:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833823.292996:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e800, rc 0) 00000100:00100000:0.0:1787833823.293069:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+57:10538:x1874679367259648:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1220us (5867us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787833823.293078:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:0.0:1787833823.297852:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833823.298469:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367259904 00000100:00100000:2.0:1787833823.298479:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367259904 00000100:00100000:2.0:1787833823.298567:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:2.0:1787833823.298578:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+57:10538:x1874679367259904:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787833823.298637:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833823.298667:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c1e expref: 57 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298703:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021d900) 00010000:00010000:2.0:1787833823.298716:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833823.298736:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298751:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298761:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298816:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298825:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298832:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298911:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298919:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298926:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298933:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833823.298937:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298952:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298962:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:2.0:1787833823.298964:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833823.298969:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298975:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775550 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298984:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298990:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.298996:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.299002:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833823.299004:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.299011:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.299018:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2029c22f (ffff9b6474279400) 00010000:00010000:2.0:1787833823.299021:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833823.299024:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.299040:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775557 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2029c22f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833823.299126:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+56:10538:x1874679367259904:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 549us (1282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787833823.299133:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:1.0:1787833823.301860:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.301941:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367260032 00000100:00100000:0.0:1787833823.301955:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367260032 00000100:00100000:0.0:1787833823.302046:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:0.0:1787833823.302058:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+56:10538:x1874679367260032:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833823.302078:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833823.302104:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e77555e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c25 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.302170:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.302184:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.302196:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.302290:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e77555e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c25 expref: 58 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.302311:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c25 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.302320:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:0.0:1787833823.302323:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787833823.302326:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f000, rc 0) 00000100:00100000:0.0:1787833823.302447:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+57:10538:x1874679367260032:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 391us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833823.302455:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:1.0:1787833823.307161:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.307371:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367260288 00000100:00100000:3.0:1787833823.307384:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367260288 00000100:00100000:3.0:1787833823.307461:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:3.0:1787833823.307476:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460340f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+57:10538:x1874679367260288:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787833823.307607:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.307795:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.307813:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833823.308291:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:3.0:1787833823.308774:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a9dd0f4 reply state 00000000245318fb transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833823.308795:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833823.309218:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460340f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+59:10538:x1874679367260288:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 1741us (2067us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787833823.309229:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 119 00010000:00010000:0.0:1787833823.313894:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.313913:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.313921:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.313944:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833823.313951:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.313960:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833823.313978:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:0.0:1787833823.313978:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:0.0:1787833823.313987:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787833823.313992:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.313999:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e77556c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833823.314050:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367260416 00000100:00100000:0.0:1787833823.314059:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367260416 00000100:00100000:0.0:1787833823.314119:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:0.0:1787833823.314127:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+58:10538:x1874679367260416:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833823.314157:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833823.314174:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c2c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.314238:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c2c expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.314252:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c2c expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.314285:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:0.0:1787833823.314288:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833823.314290:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f800, rc 0) 00000100:00100000:0.0:1787833823.314390:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+59:10538:x1874679367260416:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 262us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833823.314398:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:1.0:1787833823.325962:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.326054:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367260544 00000100:00100000:0.0:1787833823.326072:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367260544 00000100:00100000:0.0:1787833823.326156:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:0.0:1787833823.326168:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367260544:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787833823.326323:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833823.326577:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+9:2344:x1874679367260544:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 409us (632us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787833823.326588:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:3.0:1787833823.329818:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.330183:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367260800 00000100:00100000:0.0:1787833823.330201:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367260800 00000100:00100000:0.0:1787833823.330279:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:0.0:1787833823.330289:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+59:10538:x1874679367260800:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787833823.330578:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+60:10538:x1874679367260800:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 290us (775us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787833823.330587:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:1.0:1787833823.334222:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833823.334759:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367261056 00000100:00100000:2.0:1787833823.334776:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367261056 00000100:00100000:2.0:1787833823.334910:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:2.0:1787833823.334934:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+60:10538:x1874679367261056:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787833823.335242:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+60:10538:x1874679367261056:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 311us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833823.335251:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:1.0:1787833823.342176:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.342384:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367261184 00000100:00100000:0.0:1787833823.342395:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367261184 00000100:00100000:0.0:1787833823.342463:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:0.0:1787833823.342474:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+60:10538:x1874679367261184:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833823.342514:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833823.342549:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77557a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c33 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.342615:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.342629:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.342653:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833823.342687:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833823.342705:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.342731:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77557a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c33 expref: 62 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.342748:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c33 expref: 61 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.342757:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:0.0:1787833823.342760:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787833823.342763:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f400, rc 0) 00000100:00100000:0.0:1787833823.342826:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+61:10538:x1874679367261184:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 354us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833823.342833:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:0.0:1787833823.348810:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.351658:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367261312 00000100:00100000:3.0:1787833823.351673:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367261312 00000100:00100000:3.0:1787833823.351749:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:3.0:1787833823.351770:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+9:2345:x1874679367261312:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833823.351790:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833823.351812:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c3a expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833823.351861:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902ddf, blocks: 0x1 00010000:00010000:3.0:1787833823.351883:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:3.0:1787833823.352013:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833823.352021:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c3a expref: 10 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.352038:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c3a expref: 10 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.352049:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2d600, rc 0) 00000100:00100000:3.0:1787833823.352110:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+10:2345:x1874679367261312:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 344us (3311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833823.352119:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:1.0:1787833823.358544:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.358940:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367261568 00000100:00100000:3.0:1787833823.358952:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367261568 00000100:00100000:3.0:1787833823.359033:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:3.0:1787833823.359046:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+61:10538:x1874679367261568:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787833823.359214:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+61:10538:x1874679367261568:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 170us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833823.359222:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:1.0:1787833823.364000:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.364135:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367261696 00000100:00100000:3.0:1787833823.364146:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367261696 00000100:00100000:3.0:1787833823.364209:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:3.0:1787833823.364219:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477839a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+10:10538:x1874679367261696:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833823.364251:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833823.364270:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c41 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.364305:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c3a expref: 11 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.364316:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833823.364321:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833823.364327:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.364403:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c3a expref: 11 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.364418:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c3a expref: 11 pid: 6661 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833823.364433:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477729a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1874679375661184:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833823.364595:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea480 going to sleep for 11 seconds 00000100:00100000:1.0:1787833823.369089:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.369263:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477729a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1874679375661184:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833823.369300:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.369320:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c400, rc 0) 00000100:00100000:3.0:1787833823.369437:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477839a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+11:10538:x1874679367261696:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 5219us (5446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833823.369446:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:2.0:1787833823.370546:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367261824 00000100:00100000:2.0:1787833823.370558:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367261824 00010000:00010000:2.0:1787833823.370734:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c3a expref: 11 pid: 6661 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833823.370822:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:2.0:1787833823.370834:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644600a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+11:2345:x1874679367261824:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833823.370850:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833823.370873:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c3a expref: 11 pid: 6661 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.370889:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c3a expref: 11 pid: 6661 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.370933:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3d9afb/0x2bdb54ee5e775588 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c3a expref: 11 pid: 6661 timeout: 402 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.370951:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833823.370955:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833823.370976:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.370986:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.371022:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833823.371036:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477432580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5801:1874679375661312:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787833823.371119:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64457c0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833823.374247:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477432580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5801:1874679375661312:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787833823.374275:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833823.374398:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644600a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+10:2345:x1874679367261824:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 3566us (5320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833823.374410:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:1.0:1787833823.376816:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.376979:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367261952 00000100:00100000:3.0:1787833823.376989:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367261952 00002000:00100000:3.0:1787833823.377039:0:6665:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b6477838b40 x1874679367261952/t0(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:629/0 lens 504/0 e 0 to 0 dl 1787833834 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833823.377050:0:6665:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6477838b40 with x1874679367261952 ext(0->12) 00002000:00010000:3.0:1787833823.377056:0:6665:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b6477838b40 00000100:00100000:3.0:1787833823.377120:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787833823.377132:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477838b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:320cb14b-678a-483a-8914-ee446104f369+10:2345:x1874679367261952:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787833823.378001:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477838b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:320cb14b-678a-483a-8914-ee446104f369+12:2345:x1874679367261952:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 867us (1189us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787833823.378013:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00002000:00100000:3.0:1787833823.378021:0:6665:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b6477838b40 x1874679367261952/t4294967308(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:629/0 lens 504/448 e 0 to 0 dl 1787833834 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833823.378030:0:6665:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6477838b40 with x1874679367261952 ext(0->12) 00002000:00010000:3.0:1787833823.378035:0:6665:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b6477838b40 00000100:00100000:1.0:1787833823.381079:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.381185:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367262080 00000100:00100000:0.0:1787833823.381195:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367262080 00000100:00100000:0.0:1787833823.381292:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:0.0:1787833823.381305:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+61:10538:x1874679367262080:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787833823.454278:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787833823.454322:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1787833823.454385:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787833823.454420:0:5838:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b64772ea0c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787833823.454425:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6443ee6400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b64772ea3c0 00000020:00080000:3.0:1787833823.454428:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6443ee6f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b646e182000 00000004:00080000:3.0:1787833823.454440:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787833823.454465:0:5838:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b64772ea840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787833823.454468:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6481cce600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b64772eaf00 00000020:00080000:3.0:1787833823.454471:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6481cce400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6450d29000 00000020:00080000:3.0:1787833823.454493:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787833823.454711:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787833823.455090:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e0c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375661440:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787833823.455234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833823.455844:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+15:10538:x1874679367262080:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 74538us (74771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833823.455865:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:1.0:1787833823.455966:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647783a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375661568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787833823.455999:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833823.460307:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.460325:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375661440 00000100:00100000:0.0:1787833823.460335:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375661440 00000100:00100000:3.0:1787833823.460595:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375661568 00000100:00100000:3.0:1787833823.460601:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375661568 00000100:00100000:3.0:1787833823.460655:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787833823.460665:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1874679375661568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787833823.460692:0:6661:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787833823.460724:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a902ddd, atime: 0x6a902ddd, ctime: 0x6a902ddd, blocks: 0x1 00010000:00010000:3.0:1787833823.460732:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.460747:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=302s v=(0 0) 00010000:00010000:3.0:1787833823.460751:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833823.460758:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.460777:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.460785:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.460810:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.460827:0:6661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787833823.461385:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375661568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 721us (5384us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787833823.461393:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1787833823.461425:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833823.461432:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.461440:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833823.461444:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.461453:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.461470:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.461490:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775596 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.461507:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833823.461516:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833823.461529:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787833823.461836:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787833823.461876:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b647783a580/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787833823.461883:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647783a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375661568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787833823.462023:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787833823.462036:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477729a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1874679375661440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787833823.462058:0:6660:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1787833823.462075:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.462092:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba0 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.462100:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1787833823.462103:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833823.462107:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.462137:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba0 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.462151:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba0 expref: 11 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833823.462178:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e0c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1874679375661696:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833823.462248:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444280180 going to sleep for 11 seconds 00000100:00100000:3.0:1787833823.466585:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367262208 00000100:00100000:3.0:1787833823.466600:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367262208 00000100:00100000:2.0:1787833823.466839:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.466968:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:3.0:1787833823.466980:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+12:2344:x1874679367262208:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787833823.469707:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367262336 00000100:00100000:1.0:1787833823.469720:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367262336 00010000:00010000:1.0:1787833823.469764:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba0 expref: 13 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833823.469801:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:1.0:1787833823.469810:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477430780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+13:2344:x1874679367262336:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833823.469824:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833823.469830:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba0 expref: 13 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.469844:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba0 expref: 13 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.469869:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833823.469873:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833823.469879:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.469904:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.469936:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833823.470014:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477430780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+13:2344:x1874679367262336:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 205us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833823.470022:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00010000:00010000:0.0:1787833823.471910:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024dce39b/0x2bdb54ee5e775358 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ba0 expref: 12 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833823.471943:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e0c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1874679375661696:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833823.471970:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.471982:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.471989:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.472000:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.472008:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.472028:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787833823.472794:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477729a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1874679375661440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10761us (17558us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787833823.472826:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1787833823.474112:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b646e0c03c0/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787833823.474132:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e0c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375661440:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787833823.476722:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833823.476743:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.476757:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ec00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833823.476761:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.476772:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.476794:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.476801:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e77559d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.476820:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833823.476822:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833823.476824:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787833823.516494:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1787833823.516821:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1787833823.517093:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+9:2344:x1874679367262208:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 50110us (56792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833823.517105:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000001:00080000:2.0:1787833823.518591:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1787833823.520753:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833823.520848:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367262592 00000100:00100000:1.0:1787833823.520860:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367262592 00000100:00100000:1.0:1787833823.520977:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:1.0:1787833823.520988:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+15:10538:x1874679367262592:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787833823.521047:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833823.523415:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c33 expref: 15 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.523438:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:1.0:1787833823.523443:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833823.523517:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.523542:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.523575:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833823.524034:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000486da4ea reply state 00000000a78d6332 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833823.524042:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833823.524151:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477432580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+16:10538:x1874679367262592:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 3165us (3404us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787833823.524158:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:1.0:1787833823.527485:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.527970:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367262720 00000100:00100000:0.0:1787833823.527982:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367262720 00000100:00100000:0.0:1787833823.528053:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:0.0:1787833823.528063:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367262720:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787833823.528294:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787833823.528297:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787833822 00002000:00010000:0.0:1787833823.528300:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787833821 00002000:00010000:0.0:1787833823.528302:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787833823 -> 1787833822 00002000:00010000:0.0:1787833823.528304:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787833823.528394:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367262720:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 333us (926us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787833823.528401:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00010000:00010000:3.0:1787833823.531066:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.531084:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.531092:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.531098:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833823.531103:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.531111:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.531130:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:3.0:1787833823.531133:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833823.531138:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.531144:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7755a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833823.531553:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833823.531637:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367262976 00000100:00100000:1.0:1787833823.531647:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367262976 00000100:00100000:1.0:1787833823.531702:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:1.0:1787833823.531712:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+15:10538:x1874679367262976:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787833823.531779:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.531794:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c25 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.531803:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.531839:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c25 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.531853:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c25 expref: 15 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833823.531882:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647783b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375661824:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833823.531983:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833823.535546:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.535920:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647783b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375661824:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833823.535965:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833823.536145:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367263104 00000100:00100000:0.0:1787833823.536153:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367263104 00010000:00010000:0.0:1787833823.536193:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c25 expref: 16 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833823.536229:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:0.0:1787833823.536237:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477839680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+16:2344:x1874679367263104:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833823.536249:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833823.536254:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c25 expref: 16 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.536269:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c25 expref: 16 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.536293:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c25 expref: 16 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.536309:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:0.0:1787833823.536313:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.536321:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.536329:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.536384:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833823.536436:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477839680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+15:2344:x1874679367263104:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 198us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833823.536444:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00010000:00010000:3.0:1787833823.536997:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.537007:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.537036:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.537043:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.537049:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.537055:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833823.537060:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.537068:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.537079:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:3.0:1787833823.537082:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787833823.537086:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.537091:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833823.537175:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+14:10538:x1874679367262976:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 5463us (5626us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787833823.537185:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:1.0:1787833823.541816:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.541906:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367263232 00000100:00100000:0.0:1787833823.541923:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367263232 00000100:00100000:0.0:1787833823.541971:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:0.0:1787833823.541981:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477838f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+7:2346:x1874679367263232:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787833823.542027:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.542068:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.542078:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833823.542082:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833823.542087:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.542121:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.542134:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 7 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833823.542149:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e0c1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1874679375661952:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833823.542250:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833823.545270:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e0c1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1874679375661952:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833823.545301:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833823.547810:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.548032:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367263360 00000100:00100000:3.0:1787833823.548041:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367263360 00010000:00010000:3.0:1787833823.548084:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 8 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833823.548127:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787833823.548137:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367263360:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833823.548151:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833823.548172:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 8 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.548186:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 8 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.548208:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e77558f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c41 expref: 8 pid: 6659 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.548224:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833823.548229:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833823.548234:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.548262:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.548293:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833823.548570:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833823.549006:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367263360:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 867us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833823.549016:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00010000:00010000:1.0:1787833823.549180:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.549188:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.549210:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.549215:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.549220:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.549236:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ee00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833823.549239:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.549245:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.549254:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.549258:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ed0b906/0x2bdb54ee5e7755b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833823.549309:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477838f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+6:2346:x1874679367263232:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 7330us (7504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833823.549316:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787833823.553466:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.553647:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367263616 00000100:00100000:3.0:1787833823.553657:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367263616 00000100:00100000:3.0:1787833823.553712:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 127 00000100:00100000:3.0:1787833823.553722:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+14:10538:x1874679367263616:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787833823.553808:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.553824:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.553832:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.554050:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.554062:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c2c expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.554071:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.554117:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c2c expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.554128:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c2c expref: 15 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833823.554138:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477728b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375662080:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833823.554202:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772eaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833823.562163:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477728b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375662080:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833823.562196:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833823.563448:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833823.563611:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367263744 00000100:00100000:2.0:1787833823.563618:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367263744 00010000:00010000:2.0:1787833823.563656:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c2c expref: 16 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833823.563695:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:2.0:1787833823.563702:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+16:2345:x1874679367263744:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833823.563715:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833823.563720:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c2c expref: 16 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.563729:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c2c expref: 16 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.563747:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775573 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c2c expref: 16 pid: 5816 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.563762:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:2.0:1787833823.563767:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.563775:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.563782:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.563811:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833823.563859:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+15:2345:x1874679367263744:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 158us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833823.563864:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00010000:00010000:3.0:1787833823.563980:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833823.563989:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833823.564147:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787833823.564249:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787833823.564280:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787833823.564436:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477728b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5817:1874679375662208:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787833823.564486:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833823.564512:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea600 going to sleep for 11 seconds 00000100:00100000:1.0:1787833823.565181:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375662208 00000100:00100000:1.0:1787833823.565189:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375662208 00000100:00100000:1.0:1787833823.565244:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787833823.565253:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5817:x1874679375662208:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787833823.567209:0:5817:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1787833823.567220:0:5817:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1787833823.567242:0:5817:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b646e0c03c0 x1874679375661440/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787833839 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833823.567263:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477728b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5817:1874679375662208:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787833823.567760:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5817:x1874679375662208:12345-0@lo:1000:mdt00_002.0 Request processed in 2506us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833823.567771:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:2.0:1787833823.573171:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787833823.573294:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477432940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5817:1874679375662336:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787833823.573736:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833823.573826:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452de5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787833823.573873:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375662336 00000100:00100000:0.0:1787833823.573882:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375662336 00000100:00100000:0.0:1787833823.574041:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787833823.574051:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477431680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5817:x1874679375662336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787833823.574283:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477431680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5817:x1874679375662336:12345-0@lo:1000:mdt00_002.0 Request processed in 233us (546us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787833823.574291:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833823.574463:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477432940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5817:1874679375662336:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787833823.574562:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574574:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574581:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574586:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833823.574591:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574600:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574623:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b646021de00) 00010000:00010000:2.0:1787833823.574627:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833823.574686:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574693:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7755c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574722:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574728:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574743:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574749:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833823.574751:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574757:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574766:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833823.574768:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833823.574775:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77550a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c10 expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574785:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77550a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c10 expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574794:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77550a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c10 expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.574824:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77550a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c10 expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833823.574837:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64772d9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375662464:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787833823.574958:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452de5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787833823.581302:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833823.581414:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64772d9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375662464:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787833823.581456:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581467:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775503 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581505:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581529:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581542:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581553:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581559:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581566:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581571:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833823.581575:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581582:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581594:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833823.581597:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833823.581621:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.581627:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e7755c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.582178:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.582184:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.582190:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.582196:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833823.582199:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.582205:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.582214:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833823.582217:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787833823.582220:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.582226:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e7755b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787833823.582733:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833823.582738:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787833823.583208:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367263872 00000100:00100000:3.0:1787833823.583217:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367263872 00000100:00100000:3.0:1787833823.583266:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:3.0:1787833823.583275:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+19:10537:x1874679367263872:12345-192.168.202.15@tcp:49:lfs.0 00000040:00080000:2.0:1787833823.583844:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787833823.583870:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833823.584542:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+19:10537:x1874679367263872:12345-192.168.202.15@tcp:49:lfs.0 Request processed in 1263us (3246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833823.584554:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:2.0:1787833823.584855:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+18:10538:x1874679367263616:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 31133us (31397us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787833823.584866:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 127 00000020:00080000:2.0:1787833823.584870:0:5817:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787833823.588893:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.589068:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833823.589204:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367264128 00000100:00100000:2.0:1787833823.589215:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367264128 00000100:00100000:2.0:1787833823.589284:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:2.0:1787833823.589296:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+18:10538:x1874679367264128:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787833823.590174:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787833823.590249:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787833823.590287:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.590300:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.590309:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.590315:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.590320:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.590323:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.590514:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787833823.590757:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+20:10538:x1874679367264128:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1460us (1870us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787833823.590775:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000020:00080000:2.0:1787833823.590781:0:5819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787833823.591591:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367264384 00000100:00100000:1.0:1787833823.591709:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367264384 00000100:00100000:1.0:1787833823.591755:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 128 00000100:00100000:1.0:1787833823.591764:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+20:10537:x1874679367264384:12345-192.168.202.15@tcp:58:lfs.0 00000040:00080000:1.0:1787833823.592145:0:7195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787833823.592217:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+20:10537:x1874679367264384:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 452us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833823.592225:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 128 00010000:00010000:0.0:1787833823.597541:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833823.597558:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.597570:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833823.597574:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.597585:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.597614:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6474279400) 00010000:00010000:0.0:1787833823.597618:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787833823.597622:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.597796:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7755ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.597829:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833823.597831:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833823.597833:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833823.638107:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833823.638239:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367264512 00000100:00100000:1.0:1787833823.638249:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367264512 00000100:00100000:1.0:1787833823.640222:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 129 00000100:00100000:1.0:1787833823.640238:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+20:10540:x1874679367264512:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833823.640264:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833823.640299:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7755d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c48 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.640399:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.640415:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.640428:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.640444:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.640452:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833823.640489:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.641146:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.641162:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c09 expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.641171:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.641219:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c09 expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.641248:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c09 expref: 21 pid: 5815 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833823.641264:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e0c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375662592:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833823.641392:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833823.646120:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833823.646397:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e0c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375662592:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833823.646430:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833823.646675:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367264768 00000100:00100000:3.0:1787833823.646683:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367264768 00000100:00100000:3.0:1787833823.646742:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:3.0:1787833823.646752:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+22:5587:x1874679367264768:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787833823.646984:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+23:5587:x1874679367264768:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 233us (873us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787833823.646992:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:1.0:1787833823.650162:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833823.653884:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367264896 00000100:00100000:3.0:1787833823.653902:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367264896 00010000:00010000:2.0:1787833823.654790:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c09 expref: 23 pid: 5815 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833823.654901:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:2.0:1787833823.654923:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+23:2345:x1874679367264896:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833823.654942:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833823.654949:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c09 expref: 23 pid: 5815 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.654963:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c09 expref: 23 pid: 5815 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.654985:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7754f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c09 expref: 23 pid: 5815 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.655002:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833823.655007:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.655016:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.655024:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833823.655079:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833823.655217:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655226:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833823.655281:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787833823.655287:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833823.655309:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655322:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655364:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655385:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655391:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655397:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833823.655402:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655410:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655420:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:0.0:1787833823.655423:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833823.655427:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655432:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7755dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655444:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655450:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655457:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655461:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833823.655469:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655484:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655493:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6451e01200) 00010000:00010000:0.0:1787833823.655495:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833823.655498:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655504:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7755e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655553:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7755d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c48 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655567:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c48 expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833823.655574:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:0.0:1787833823.655576:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833823.655578:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e600, rc 0) 00000100:00100000:2.0:1787833823.655669:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+22:2345:x1874679367264896:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 756us (5515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833823.655678:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:0.0:1787833823.656383:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+21:10540:x1874679367264512:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 16147us (18281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833823.656390:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 129 00000040:00080000:2.0:1787833824.436990:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833824.437001:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833824.437047:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787833824.437054:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787833824.577809:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787833824.636624:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833824.636636:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833824.636695:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787833824.636703:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833824.636861:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477430f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375662720:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787833824.636988:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64622f20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833824.643756:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477430f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375662720:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787833824.647141:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833824.647237:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367265024 00000100:00100000:3.0:1787833824.647246:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367265024 00000100:00100000:3.0:1787833824.647319:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:3.0:1787833824.647328:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+21:10552:x1874679367265024:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787833824.647396:0:5816:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787833824.647517:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+21:10552:x1874679367265024:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 182us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833824.647542:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:0.0:1787833824.651581:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833824.651678:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367265280 00000100:00100000:2.0:1787833824.651688:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367265280 00000100:00100000:2.0:1787833824.651747:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:2.0:1787833824.651757:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+21:10552:x1874679367265280:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833824.651777:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833824.651797:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e7755f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c4f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833824.651895:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e7755f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833824.652025:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e7755f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833824.652036:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e7755f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833824.652048:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787833824.652179:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e7755f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c4f expref: 24 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833824.652197:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e7755f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c4f expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833824.652251:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833824.652255:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833824.652260:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2e00, rc 0) 00000100:00100000:2.0:1787833824.652470:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+23:10552:x1874679367265280:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 714us (896us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787833824.652478:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:2.0:1787833824.657658:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833824.657868:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367265536 00000100:00100000:3.0:1787833824.657879:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367265536 00000100:00100000:3.0:1787833824.657950:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 132 00000100:00100000:3.0:1787833824.657960:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+23:10552:x1874679367265536:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787833824.658036:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833824.658053:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833824.658065:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833824.658262:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833824.658280:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833824.658286:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833824.658293:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833824.658298:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833824.658306:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833824.658335:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:3.0:1787833824.658366:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787833824.658372:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833824.658378:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2de00/0x2bdb54ee5e775606 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787833824.658721:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833824.658726:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833824.659206:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787833824.659216:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787833824.659568:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477430f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+24:10552:x1874679367265536:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 1606us (1915us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787833824.659577:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 132 00000100:00100000:0.0:1787833824.662119:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833824.662205:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367265792 00000100:00100000:3.0:1787833824.662214:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367265792 00000100:00100000:3.0:1787833824.662275:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:3.0:1787833824.662285:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+24:10552:x1874679367265792:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787833824.662571:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+25:10552:x1874679367265792:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 286us (460us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787833824.662578:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:1.0:1787833824.677095:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833824.677181:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367265920 00000100:00100000:0.0:1787833824.677190:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367265920 00000100:00100000:0.0:1787833824.677259:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787833824.677279:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+25:2344:x1874679367265920:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833824.677298:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833824.677324:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e7755f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c4f expref: 25 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833824.677372:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:0.0:1787833824.677378:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833824.677432:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+24:2344:x1874679367265920:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 163us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833824.677439:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787833825.340775:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375663104:0@lo:400:kworker.0 00000100:00100000:1.0:1787833825.340854:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833825.340980:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477431a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375662848:0@lo:400:kworker.0 00000100:00100000:0.0:1787833825.341015:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833825.341045:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833825.341051:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375662976:0@lo:400:kworker.0 00000100:00100000:0.0:1787833825.341071:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833825.341101:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375662848 00000100:00100000:0.0:1787833825.341121:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375662848 00000100:00100000:0.0:1787833825.341167:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787833825.341176:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375662848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833825.341227:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375662848:12345-0@lo:400:kworker.0 Request processed in 52us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833825.341234:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787833825.341294:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477431a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375662848:0@lo:400:kworker.0 00000100:00100000:0.0:1787833825.341372:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375663104 00000100:00100000:0.0:1787833825.341376:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375663104 00000100:00100000:0.0:1787833825.341408:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375662976 00000100:00100000:0.0:1787833825.341410:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375662976 00000100:00100000:0.0:1787833825.341425:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787833825.341430:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375663104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833825.341923:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787833825.341934:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375662976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833825.341981:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375662976:12345-0@lo:400:kworker.0 Request processed in 51us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833825.341988:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787833825.342020:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375662976:0@lo:400:kworker.0 00000100:00100000:3.0:1787833825.342056:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375663232:0@lo:400:kworker.0 00000100:00100000:3.0:1787833825.342096:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833825.342130:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375663232 00000100:00100000:3.0:1787833825.342135:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375663232 00000100:00100000:3.0:1787833825.342168:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787833825.342175:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375663232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833825.342211:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375663232:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833825.342217:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787833825.342243:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375663232:0@lo:400:kworker.0 00000100:00080000:1.0:1787833825.342919:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833825.342926:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833825.343164:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375663104:12345-0@lo:400:kworker.0 Request processed in 1729us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833825.343173:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787833825.343611:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833825.343725:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833825.343739:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375663488:0@lo:400:kworker.0 00000100:00100000:0.0:1787833825.343785:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833825.343831:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375663488 00000100:00100000:0.0:1787833825.343837:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375663488 00000100:00100000:0.0:1787833825.343896:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787833825.343916:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1874679375663488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833825.343961:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1874679375663488:12345-0@lo:400:kworker.0 Request processed in 47us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833825.343967:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787833825.344003:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375663488:0@lo:400:kworker.0 00000100:00080000:0.0:1787833825.344028:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833825.344611:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375663104:0@lo:400:kworker.0 00000100:00100000:1.0:1787833825.344748:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375663360:0@lo:400:kworker.0 00000100:00100000:1.0:1787833825.344803:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833825.345330:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375663360 00000100:00100000:3.0:1787833825.345337:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375663360 00000100:00100000:3.0:1787833825.345441:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787833825.345449:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375663360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833825.345519:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647fa152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375663360:12345-0@lo:400:kworker.0 Request processed in 71us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833825.345526:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787833825.345654:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375663360:0@lo:400:kworker.0 00000100:00080000:0.0:1787833825.345723:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787833825.596656:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833825.858842:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833825.858874:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375663616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833825.858953:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833825.859033:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375663616 00000100:00100000:2.0:1787833825.859042:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375663616 00000100:00100000:2.0:1787833825.859092:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787833825.859101:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375663616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833825.859143:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833825.859191:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375663616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833825.859199:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787833825.859257:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375663616:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787833826.347301:0:12137:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833826.347311:0:12137:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833826.347388:0:12137:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787833826.347394:0:12137:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787833826.454450:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787833826.454478:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787833826.454489:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:3.0:1787833826.587406:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833826.593245:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367266176 00000100:00100000:1.0:1787833826.593259:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367266176 00000100:00100000:1.0:1787833826.593330:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 133 00000100:00100000:1.0:1787833826.593362:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647772b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+24:10572:x1874679367266176:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833826.593390:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833826.593411:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77560d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c56 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833826.593547:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775614 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833826.593563:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775614 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833826.593577:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775614 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833826.593589:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787833826.593700:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77560d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c56 expref: 27 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833826.593712:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775614 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c56 expref: 26 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833826.593718:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:1.0:1787833826.593721:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787833826.593723:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199800, rc 0) 00000100:00100000:1.0:1787833826.593778:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647772b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+26:10572:x1874679367266176:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 441us (6383us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787833826.597407:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 133 00000100:00080000:0.0:1787833826.597823:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833826.614898:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833826.615137:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367266304 00000100:00100000:2.0:1787833826.615146:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367266304 00000100:00100000:2.0:1787833826.615199:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 134 00000100:00100000:2.0:1787833826.615208:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+26:10572:x1874679367266304:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787833826.615278:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833826.615295:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833826.615306:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833826.615331:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833826.615358:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833826.615366:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833826.615381:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833826.615385:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833826.615393:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833826.615405:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:2.0:1787833826.615407:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833826.615411:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833826.615417:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775622 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833826.615500:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+26:10572:x1874679367266304:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 282us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833826.615508:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 134 00010000:00010000:0.0:1787833826.622046:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833826.793904:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833826.794429:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367266432 00000100:00100000:3.0:1787833826.794439:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367266432 00000100:00080000:0.0:1787833826.794528:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833826.794541:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:3.0:1787833826.794552:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367266432:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:3.0:1787833826.794573:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833826.794596:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775629 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c5d expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833826.794642:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a902dde, atime: 0x6a902ddd, ctime: 0x6a902dde, blocks: 0xb 00010000:00010000:3.0:1787833826.794663:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=305s v=(0 0) 00010000:00010000:3.0:1787833826.794668:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833826.794677:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775629 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c5d expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833826.794697:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775629 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c5d expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833826.794710:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2de00, rc 0) 00000100:00100000:3.0:1787833826.794768:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367266432:12345-192.168.202.15@tcp:101:cat.0 Request processed in 218us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833826.794775:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:0.0:1787833826.798605:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833826.798862:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367266560 00000100:00100000:2.0:1787833826.798872:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367266560 00002000:00100000:2.0:1787833826.798932:0:6666:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9b646e0c3840 x1874679367266560/t0(0) o3->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:632/0 lens 488/0 e 0 to 0 dl 1787833837 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787833826.798943:0:6666:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b646e0c3840 with x1874679367266560 ext(0->4095) 00002000:00010000:2.0:1787833826.798948:0:6666:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b646e0c3840 00000100:00100000:2.0:1787833826.798981:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:2.0:1787833826.798990:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367266560:12345-192.168.202.15@tcp:3:cat.0 00000100:00100000:2.0:1787833826.801600:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367266560:12345-192.168.202.15@tcp:3:cat.0 Request processed in 2595us (2988us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787833826.801632:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00002000:00100000:2.0:1787833826.801649:0:6666:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9b646e0c3840 x1874679367266560/t0(0) o3->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:632/0 lens 488/4536 e 0 to 0 dl 1787833837 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787833826.801661:0:6666:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b646e0c3840 with x1874679367266560 ext(0->4095) 00002000:00010000:2.0:1787833826.801666:0:6666:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b646e0c3840 00000100:00100000:1.0:1787833827.512817:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833827.512858:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833827.512898:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833827.512919:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833827.512946:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833827.512989:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367267200 00000100:00100000:1.0:1787833827.512998:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367267200 00000100:00100000:1.0:1787833827.513067:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367266816 00000100:00100000:1.0:1787833827.513071:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367266816 00000100:00100000:1.0:1787833827.513091:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00100000:1.0:1787833827.513100:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367267200:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833827.513177:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367267200:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 77us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833827.513185:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00100000:1.0:1787833827.513201:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 136 00000100:00100000:1.0:1787833827.513208:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+26:2344:x1874679367266816:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833827.513230:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+26:2344:x1874679367266816:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833827.513236:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 136 00000100:00100000:1.0:1787833827.513271:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367266944 00000100:00100000:1.0:1787833827.513274:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367266944 00000100:00100000:1.0:1787833827.513297:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367267072 00000100:00100000:1.0:1787833827.513299:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367267072 00000100:00100000:1.0:1787833827.513318:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:1.0:1787833827.513325:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477406940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367266944:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833827.513374:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477406940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367266944:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 50us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833827.513381:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:1.0:1787833827.513393:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:1.0:1787833827.513399:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:2344:x1874679367267072:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833827.513421:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+5:2344:x1874679367267072:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833827.513434:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00080000:1.0:1787833827.513479:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833827.513492:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833827.515461:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367266688 00000100:00100000:3.0:1787833827.515475:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367266688 00000100:00100000:3.0:1787833827.515545:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 287 00000100:00100000:3.0:1787833827.515556:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367266688:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833827.515648:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367266688:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 86us (2834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833827.515656:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 287 00010000:00010000:1.0:1787833827.646286:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787833827.908545:0:6770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306664201873ns, next at 307664198846ns, rc = 0 00000100:00100000:0.0:1787833827.908619:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833827.908641:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375663744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833827.908714:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833827.908829:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375663744 00000100:00100000:1.0:1787833827.908837:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375663744 00000100:00100000:1.0:1787833827.908902:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787833827.908912:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874679375663744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833827.908948:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833827.908996:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874679375663744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833827.909003:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787833827.909053:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375663744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787833827.909117:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787833828.508987:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:1.0:1787833828.509219:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000001:00080000:3.0:1787833828.509368:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1787833828.509402:0:5838:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6452de5b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787833828.509408:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6443f4bd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6452de59c0 00000020:00080000:3.0:1787833828.509425:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6443f4b500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6477499800 00000020:00080000:3.0:1787833828.509733:0:5838:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787833828.509804:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787833828.510084:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1787833828.510196:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375663872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787833828.510598:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833828.510715:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375663872 00000100:00100000:0.0:1787833828.510723:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375663872 00000100:00100000:0.0:1787833828.510860:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787833828.510935:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375663872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787833828.511100:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787833828.511104:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787833822 -> 1787833822 00002000:00010000:0.0:1787833828.511106:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1787833821 -> 1787833821 00002000:00010000:0.0:1787833828.511108:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787833822 -> 1787833822 00002000:00010000:0.0:1787833828.511111:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787833828.511155:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3281:x1874679375663872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (817us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787833828.511163:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:0.0:1787833828.511389:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b646e1a0f00/2, rc 0, transno 4294967312 00000100:00100000:0.0:1787833828.511553:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375663872:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787833828.680375:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787833829.015756:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787833829.015773:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1787833829.693327:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833830.460850:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64777292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375664000:0@lo:400:kworker.0 00000100:00100000:0.0:1787833830.460927:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833830.460989:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375664512:0@lo:400:kworker.0 00000100:00100000:0.0:1787833830.461019:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833830.461063:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833830.461068:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375664384:0@lo:400:kworker.0 00000100:00100000:0.0:1787833830.461097:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833830.461129:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375664512 00000100:00100000:0.0:1787833830.461136:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375664512 00000100:00100000:0.0:1787833830.461195:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787833830.461205:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375664512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833830.461256:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477431a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375664512:12345-0@lo:400:kworker.0 Request processed in 53us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833830.461263:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1787833830.461299:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833830.461332:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375664512:0@lo:400:kworker.0 00000100:00100000:3.0:1787833830.461486:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375664000 00000100:00100000:3.0:1787833830.461490:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375664000 00000100:00100000:3.0:1787833830.461527:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787833830.461534:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375664000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833830.461581:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375664000:12345-0@lo:400:kworker.0 Request processed in 47us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833830.461587:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787833830.461713:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375664128:0@lo:400:kworker.0 00000100:00100000:2.0:1787833830.461744:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833830.461772:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6445621a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375664640:0@lo:400:kworker.0 00000100:00100000:2.0:1787833830.461794:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833830.461814:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833830.461820:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375664256:0@lo:400:kworker.0 00000100:00100000:2.0:1787833830.461839:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833830.461867:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375664384 00000100:00100000:2.0:1787833830.461871:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375664384 00000100:00100000:2.0:1787833830.461904:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375664640 00000100:00100000:2.0:1787833830.461907:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375664640 00000100:00100000:2.0:1787833830.461928:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787833830.461935:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462315e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375664384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833830.461967:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462315e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375664384:12345-0@lo:400:kworker.0 Request processed in 33us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833830.461973:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787833830.461985:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787833830.462001:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375664640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833830.462035:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375664640:12345-0@lo:400:kworker.0 Request processed in 35us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833830.462041:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787833830.462063:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833830.462066:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833830.462083:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787833830.462088:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787833830.462104:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b647783a580, transno 4294967304 00000100:00100000:2.0:1787833830.462116:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6445621a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375664640:0@lo:400:kworker.0 00000100:00100000:1.0:1787833830.462525:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375664128 00000100:00100000:1.0:1787833830.462531:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375664128 00000100:00100000:1.0:1787833830.462570:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375664256 00000100:00100000:1.0:1787833830.462573:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375664256 00000100:00100000:1.0:1787833830.462598:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787833830.462605:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375664128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833830.462648:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375664128:12345-0@lo:400:kworker.0 Request processed in 44us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833830.462661:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787833830.462674:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787833830.462682:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375664256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833830.462711:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375664256:12345-0@lo:400:kworker.0 Request processed in 31us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833830.462717:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787833830.462747:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375664256:0@lo:400:kworker.0 00000100:00100000:1.0:1787833830.462757:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375664128:0@lo:400:kworker.0 00000100:00080000:1.0:1787833830.462790:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833830.462932:0:3281:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1787833830.462937:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b646e0c03c0, transno 4294967309 00000004:00080000:0.0:1787833830.462957:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967312 00000004:00080000:0.0:1787833830.462972:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b646e1a0f00, transno 4294967312 00000100:00100000:0.0:1787833830.462977:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375664384:0@lo:400:kworker.0 00000100:00100000:0.0:1787833830.462988:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64777292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375664000:0@lo:400:kworker.0 00010000:00010000:3.0:1787833830.720102:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787833830.844911:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833830.844923:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833830.845897:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1787833830.845906:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833830.977539:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833830.977573:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647783a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375664768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833830.977657:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833830.977802:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375664768 00000100:00100000:2.0:1787833830.977810:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375664768 00000100:00100000:2.0:1787833830.977867:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787833830.977876:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375664768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833830.977913:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833830.977959:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375664768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833830.977967:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787833830.978191:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647783a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375664768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787833831.741660:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833832.012484:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833832.012644:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367267328 00000100:00100000:2.0:1787833832.012664:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367267328 00000100:00100000:2.0:1787833832.012758:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00100000:2.0:1787833832.012769:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+13:10217:x1874679367267328:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787833832.012876:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+13:10217:x1874679367267328:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 Request processed in 109us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833832.012900:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00080000:1.0:1787833832.013554:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833832.014878:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833832.015051:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367267584 00000100:00100000:0.0:1787833832.015061:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367267584 00000100:00100000:0.0:1787833832.015122:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:0.0:1787833832.015133:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445623840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+13:10217:x1874679367267584:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787833832.016043:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445623840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+14:10217:x1874679367267584:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 611us (877us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787833832.016054:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:3.0:1787833832.471643:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833832.471824:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367267712 00000100:00100000:1.0:1787833832.471833:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367267712 00000100:00100000:1.0:1787833832.471932:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 136 00000100:00100000:1.0:1787833832.471939:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64456212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:11024:x1874679367267712:12345-192.168.202.15@tcp:101:lsof.0 00010000:00010000:1.0:1787833832.471955:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833832.471973:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c64 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833832.472025:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833832.472059:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833832.472069:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833832.472242:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787833832.472246:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833832.472381:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833832.472407:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c64 expref: 7 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833832.472423:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c64 expref: 6 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833832.472431:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:1.0:1787833832.472434:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833832.472447:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199000, rc 0) 00000100:00100000:1.0:1787833832.472514:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64456212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:11024:x1874679367267712:12345-192.168.202.15@tcp:101:lsof.0 Request processed in 574us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833832.472521:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 136 00000100:00080000:2.0:1787833832.479738:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833832.624987:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833832.625145:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833832.625186:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833832.625221:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833832.625255:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367268096 00000100:00100000:2.0:1787833832.625266:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367268096 00000100:00100000:2.0:1787833832.625323:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367268224 00000100:00100000:2.0:1787833832.625326:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367268224 00000100:00100000:0.0:1787833832.625489:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367267968 00000100:00100000:0.0:1787833832.625493:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367267968 00000100:00100000:0.0:1787833832.625524:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 140 00000100:00100000:0.0:1787833832.625532:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+14:2347:x1874679367267968:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833832.625609:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+14:2347:x1874679367267968:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 77us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833832.625617:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 140 00000100:00080000:0.0:1787833832.625667:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833832.625672:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833832.625864:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:2.0:1787833832.625874:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:2347:x1874679367268096:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833832.625905:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:2347:x1874679367268096:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 34us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833832.625912:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:2.0:1787833832.625927:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:2.0:1787833832.625934:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367268224:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833832.625959:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367268224:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833832.625965:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:1.0:1787833832.630031:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367267840 00000100:00100000:1.0:1787833832.630047:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367267840 00000100:00100000:1.0:1787833832.630188:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 289 00000100:00100000:1.0:1787833832.630199:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367267840:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833832.630295:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367267840:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 98us (5319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833832.630318:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 289 00010000:00010000:0.0:1787833832.765593:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833833.020777:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e0c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375664896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833833.020867:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833833.020975:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375664896 00000100:00100000:2.0:1787833833.020984:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375664896 00000100:00100000:2.0:1787833833.021048:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787833833.021058:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375664896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833833.021094:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787833833.021177:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833833.021952:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375664896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 893us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833833.021962:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787833833.024665:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e0c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375664896:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787833833.616702:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787833833.616734:0:5838:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787833833.616789:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787833833.616802:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787833833.788638:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833834.812717:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833835.587727:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375665024:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.587821:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833835.587880:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64773b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375665536:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.587909:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833835.587937:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833835.587943:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64773b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375665408:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.587968:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833835.588001:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64773b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375665280:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588025:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833835.588042:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787833835.588047:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375665152:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588068:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833835.588101:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64773b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375665664:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588124:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833835.588154:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375665536 00000100:00100000:0.0:1787833835.588161:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375665536 00000100:00100000:0.0:1787833835.588212:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375665280 00000100:00100000:0.0:1787833835.588216:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375665280 00000100:00100000:0.0:1787833835.588230:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375665152 00000100:00100000:0.0:1787833835.588232:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375665152 00000100:00100000:0.0:1787833835.588252:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787833835.588261:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375665536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588315:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477432940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375665536:12345-0@lo:400:kworker.0 Request processed in 55us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833835.588323:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787833835.588379:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787833835.588386:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375665280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588430:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375665280:12345-0@lo:400:kworker.0 Request processed in 45us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833835.588436:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787833835.588447:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787833835.588454:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375665152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588482:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375665152:12345-0@lo:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833835.588487:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787833835.588508:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375665408 00000100:00100000:0.0:1787833835.588512:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375665408 00000100:00100000:0.0:1787833835.588539:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375665664 00000100:00100000:0.0:1787833835.588542:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375665664 00000100:00100000:0.0:1787833835.588562:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787833835.588577:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375665408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588608:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375665408:12345-0@lo:400:kworker.0 Request processed in 33us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833835.588614:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787833835.588626:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787833835.588632:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375665664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588661:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375665664:12345-0@lo:400:kworker.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833835.588669:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787833835.588695:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833835.588699:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833835.588702:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833835.588744:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375665152:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588755:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64773b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375665664:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588763:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64773b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375665280:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588796:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64773b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375665408:0@lo:400:kworker.0 00000100:00100000:0.0:1787833835.588806:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64773b8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375665536:0@lo:400:kworker.0 00000100:00100000:2.0:1787833835.589024:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375665024 00000100:00100000:2.0:1787833835.589029:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375665024 00000100:00100000:2.0:1787833835.589065:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787833835.589073:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375665024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833835.589113:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375665024:12345-0@lo:400:kworker.0 Request processed in 41us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833835.589119:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787833835.589189:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375665024:0@lo:400:kworker.0 00010000:00010000:0.0:1787833835.839938:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787833835.934280:0:12339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:30:34 (1787833834) 00000100:00100000:1.0:1787833836.093952:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e0c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375665792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833836.094031:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833836.094104:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375665792 00000100:00100000:1.0:1787833836.094112:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375665792 00000100:00100000:1.0:1787833836.094157:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787833836.094166:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375665792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833836.094200:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833836.094246:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375665792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833836.094253:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787833836.094313:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e0c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375665792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787833836.860672:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833837.667411:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833837.667569:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367268480 00000100:00100000:0.0:1787833837.667581:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367268480 00000100:00100000:0.0:1787833837.668021:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 137 00000100:00100000:0.0:1787833837.668033:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+13:11289:x1874679367268480:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833837.668057:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833837.668090:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e77563e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c6b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.668166:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.668180:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.668193:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.668227:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.668236:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.668242:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.668891:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775653 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.668903:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775653 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.668911:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775653 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833837.668922:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787833837.669134:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669150:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669156:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669163:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833837.669167:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669174:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669188:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b645a7d3400) 00010000:00010000:0.0:1787833837.669191:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833837.669195:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669201:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775645 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669215:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669220:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669225:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669229:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833837.669238:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669243:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669250:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b646021d800) 00010000:00010000:0.0:1787833837.669252:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833837.669255:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.669260:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77564c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787833837.670996:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787833837.671216:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e77563e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c6b expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.671241:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775653 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c6b expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.671251:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:0.0:1787833837.671253:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833837.671257:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751ee00, rc 0) 00000100:00100000:0.0:1787833837.671412:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+15:11289:x1874679367268480:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 3380us (4072us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787833837.671422:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 137 00000100:00100000:3.0:1787833837.674936:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833837.675021:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833837.675548:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367268736 00000100:00100000:1.0:1787833837.675561:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367268736 00000100:00100000:1.0:1787833837.675636:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 138 00000100:00100000:1.0:1787833837.675649:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+15:11289:x1874679367268736:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787833837.675764:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+15:11289:x1874679367268736:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 Request processed in 118us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833837.675772:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 138 00000100:00100000:0.0:1787833837.678252:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367268608 00000100:00100000:0.0:1787833837.678268:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367268608 00000100:00100000:0.0:1787833837.678378:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787833837.678400:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446008050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+15:2347:x1874679367268608:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833837.678433:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833837.678458:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775653 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c6b expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833837.678477:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:0.0:1787833837.678482:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833837.678557:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446008050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+14:2347:x1874679367268608:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 170us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833837.678565:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787833837.743069:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833837.743167:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833837.743194:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833837.743245:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833837.743297:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367269248 00000100:00100000:3.0:1787833837.743306:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367269248 00000100:00100000:3.0:1787833837.743432:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 144 00000100:00100000:3.0:1787833837.743442:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:2345:x1874679367269248:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833837.743513:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:2345:x1874679367269248:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833837.743521:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 144 00000100:00080000:3.0:1787833837.743542:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833837.746078:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367269120 00000100:00100000:2.0:1787833837.746093:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367269120 00000100:00100000:2.0:1787833837.746175:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367268992 00000100:00100000:2.0:1787833837.746178:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367268992 00000100:00100000:2.0:1787833837.746208:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:2.0:1787833837.746218:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6445621a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367269120:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833837.746295:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6445621a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367269120:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 79us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833837.746302:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:2.0:1787833837.746320:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:2.0:1787833837.746327:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367268992:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833837.746386:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367268992:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 60us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833837.746420:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00080000:3.0:1787833837.751515:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833837.751527:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787833837.755075:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367268864 00000100:00100000:1.0:1787833837.755094:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367268864 00000100:00100000:1.0:1787833837.755182:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 291 00000100:00100000:1.0:1787833837.755195:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2345:x1874679367268864:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833837.755311:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2345:x1874679367268864:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 118us (12253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833837.755319:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 291 00010000:00010000:2.0:1787833837.884639:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787833838.025848:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833838.025859:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787833838.026455:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787833838.026466:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787833838.140713:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64777292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375665920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833838.140811:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833838.141021:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375665920 00000100:00100000:3.0:1787833838.141030:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375665920 00000100:00100000:3.0:1787833838.141105:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787833838.141115:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375665920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833838.141153:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787833838.141224:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833838.141319:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375665920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833838.141327:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787833838.141566:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64777292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375665920:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787833838.728960:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1787833838.912544:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833839.933737:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833840.057856:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833840.057944:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367269376 00000100:00100000:0.0:1787833840.057954:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367269376 00000100:00100000:0.0:1787833840.058035:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 139 00000100:00100000:0.0:1787833840.058046:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+13:11331:x1874679367269376:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833840.058067:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833840.058089:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c72 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058155:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058191:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058203:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058220:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058227:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058233:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058565:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058574:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058581:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058586:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833840.058591:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058598:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058610:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:0.0:1787833840.058619:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833840.058624:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058630:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e775668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058643:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058649:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058654:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058659:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fe00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833840.058661:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058667:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058674:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b646021d800) 00010000:00010000:0.0:1787833840.058677:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833840.058679:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058685:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77566f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058717:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775661 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c72 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058738:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:0.0:1787833840.058741:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833840.058745:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c72 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.058756:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e400, rc 0) 00000100:00100000:0.0:1787833840.058813:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+13:11331:x1874679367269376:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 769us (968us total) trans 0 rc 301/301 00000100:00100000:0.0:1787833840.058821:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 139 00000100:00080000:3.0:1787833840.059042:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1787833840.061593:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833840.061603:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787833840.062507:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787833840.062517:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833840.073494:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833840.073542:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367269632 00000100:00100000:3.0:1787833840.073553:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367269632 00000100:00100000:3.0:1787833840.073611:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 140 00000100:00100000:3.0:1787833840.073622:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+13:11331:x1874679367269632:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:3.0:1787833840.073678:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833840.073704:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83e00/0x2bdb54ee5e774fdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3aab expref: 13 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.073721:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:3.0:1787833840.073735:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833840.074438:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.074578:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c64 expref: 5 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.074589:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.074628:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c64 expref: 5 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.074645:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c64 expref: 5 pid: 7195 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833840.074660:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e0c03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375666048:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833840.074889:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833840.076975:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e0c03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375666048:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833840.077004:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833840.081477:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833840.081632:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367269760 00000100:00100000:1.0:1787833840.081641:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367269760 00010000:00010000:1.0:1787833840.081709:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c64 expref: 6 pid: 7195 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833840.081744:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:1.0:1787833840.081754:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:2344:x1874679367269760:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833840.081769:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833840.081776:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c64 expref: 6 pid: 7195 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.081790:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c64 expref: 6 pid: 7195 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.081812:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775637 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c64 expref: 6 pid: 7195 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.081852:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:1.0:1787833840.081857:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.081865:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.081872:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.081896:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833840.081944:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367269760:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 192us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833840.081952:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00010000:00010000:1.0:1787833840.081980:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.081988:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.082011:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.082020:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.082027:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787833840.085011:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787833840.085859:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787833840.085882:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.085892:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.085899:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.085906:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833840.085910:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.085918:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.085935:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279900) 00010000:00010000:1.0:1787833840.085939:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833840.085944:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.085950:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775676 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833840.085967:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d56fc745 reply state 0000000061cec0da transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833840.085976:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833840.086064:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+14:11331:x1874679367269632:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 12440us (12576us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787833840.086073:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 140 00010000:00010000:1.0:1787833840.095292:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.095319:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.095527:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.095535:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833840.095540:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.095548:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.095565:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b6451e01600) 00010000:00010000:1.0:1787833840.095568:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833840.095573:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.095580:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77567d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833840.229944:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833840.230025:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367269888 00000100:00100000:0.0:1787833840.230036:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367269888 00000100:00100000:0.0:1787833840.230099:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 141 00000100:00100000:0.0:1787833840.230110:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64773b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+13:11339:x1874679367269888:12345-192.168.202.15@tcp:101:lctl.0 00010000:00010000:0.0:1787833840.230133:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833840.230156:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c79 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.230231:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77568b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.230244:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77568b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.230286:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77568b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833840.230409:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787833840.230413:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833840.230442:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77568b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.230466:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c79 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.230484:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77568b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c79 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.230493:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d800) 00010000:00010000:0.0:1787833840.230496:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833840.230500:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f000, rc 0) 00000100:00100000:0.0:1787833840.230559:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64773b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+14:11339:x1874679367269888:12345-192.168.202.15@tcp:101:lctl.0 Request processed in 451us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.230566:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 141 00000100:00100000:2.0:1787833840.322625:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833840.322810:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367270016 00000100:00100000:0.0:1787833840.322820:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367270016 00000100:00100000:0.0:1787833840.322877:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 142 00000100:00100000:0.0:1787833840.322885:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+14:11345:x1874679367270016:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787833840.322906:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833840.322937:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c80 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323173:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323186:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323196:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323207:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323212:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323216:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323449:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7756a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323467:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7756a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323474:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7756a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833840.323519:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787833840.323523:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833840.323546:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7756a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323572:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323579:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323586:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323592:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833840.323596:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323603:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323612:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d800) 00010000:00010000:0.0:1787833840.323614:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833840.323618:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323622:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775699 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323631:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323635:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323638:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323646:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833840.323648:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323651:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323656:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b646021da00) 00010000:00010000:0.0:1787833840.323657:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833840.323658:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323662:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e7756a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323796:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c80 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323812:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7756a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c80 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.323821:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:0.0:1787833840.323823:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787833840.323824:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f200, rc 0) 00000100:00100000:0.0:1787833840.323886:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+15:11345:x1874679367270016:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1002us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.323894:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 142 00000100:00100000:1.0:1787833840.327610:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.327901:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367270272 00000100:00100000:2.0:1787833840.327912:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367270272 00000100:00100000:2.0:1787833840.328239:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 143 00000100:00100000:2.0:1787833840.328251:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477728780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+15:11345:x1874679367270272:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787833840.328275:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833840.328308:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7756ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c87 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.328512:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.328528:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.328540:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.328609:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.328616:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.328645:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787833840.329253:0:7195:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787833840.329484:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329496:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329504:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329541:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329548:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329555:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329562:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833840.329567:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329576:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329588:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:2.0:1787833840.329591:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833840.329604:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329612:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e7756b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833840.329628:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003197e39 reply state 0000000019e97cba transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833840.329638:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787833840.329675:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e7756ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c87 expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329690:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c87 expref: 17 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.329697:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279300) 00010000:00010000:2.0:1787833840.329700:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833840.329702:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3c00, rc 0) 00000100:00100000:2.0:1787833840.329789:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477728780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+18:11345:x1874679367270272:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1540us (2191us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787833840.329798:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 143 00010000:00010000:1.0:1787833840.333389:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.333408:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.333416:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.333454:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833840.333459:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.333468:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.333487:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6474279800) 00010000:00010000:1.0:1787833840.333489:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833840.333494:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.333501:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e7756bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833840.338713:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.339044:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367270400 00000100:00100000:2.0:1787833840.339054:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367270400 00000100:00100000:2.0:1787833840.339137:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:2.0:1787833840.339150:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477728b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367270400:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787833840.339177:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833840.339203:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c8e expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833840.339249:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833840.339271:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1787833840.339277:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833840.339289:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c8e expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.339309:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c8e expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.339336:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2600, rc 0) 00000100:00100000:2.0:1787833840.339453:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477728b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367270400:12345-192.168.202.15@tcp:101:bash.0 Request processed in 306us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833840.339462:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00080000:3.0:1787833840.340017:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833840.349586:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.350152:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367270528 00000100:00100000:2.0:1787833840.350165:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367270528 00000100:00100000:2.0:1787833840.350218:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787833840.350227:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e0c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+6:11345:x1874679367270528:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787833840.350245:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833840.350265:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c95 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.350296:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c8e expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.350325:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833840.350330:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833840.350336:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.350911:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c8e expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.350928:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c8e expref: 7 pid: 6661 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833840.350942:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477436580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1874679375666176:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833840.351096:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787833840.357725:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833840.357942:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367270656 00000100:00100000:1.0:1787833840.357952:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367270656 00010000:00010000:1.0:1787833840.357997:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c8e expref: 8 pid: 6661 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833840.358040:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:1.0:1787833840.358049:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b63423752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367270656:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833840.358063:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833840.358086:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c8e expref: 8 pid: 6661 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.358122:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c8e expref: 8 pid: 6661 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.358149:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833840.358153:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833840.358162:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.358172:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.358209:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833840.358224:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64777292c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1874679375666304:192.168.202.15@tcp:105: 00000100:00100000:1.0:1787833840.358319:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e540 going to sleep for 11 seconds 00010000:00010000:3.0:1787833840.359210:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3ba282b/0x2bdb54ee5e7756d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c8e expref: 8 pid: 6661 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833840.359229:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477436580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1874679375666176:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833840.359254:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.359280:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2e00, rc 0) 00000100:00100000:3.0:1787833840.360037:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e0c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+7:11345:x1874679367270528:12345-192.168.202.15@tcp:101:bash.0 Request processed in 9804us (10457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833840.360048:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:1.0:1787833840.364235:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64777292c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1874679375666304:192.168.202.15@tcp:105: 00010000:00010000:1.0:1787833840.364264:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833840.364395:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b63423752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367270656:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 6346us (6678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833840.364407:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:3.0:1787833840.364840:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.365023:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367270912 00000100:00100000:2.0:1787833840.365030:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367270912 00000100:00100000:2.0:1787833840.365081:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787833840.365091:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477436580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+17:11345:x1874679367270912:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:2.0:1787833840.365462:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477436580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+18:11345:x1874679367270912:12345-192.168.202.15@tcp:35:bash.0 Request processed in 371us (621us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787833840.365470:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:3.0:1787833840.471395:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833840.471540:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367271168 00000100:00100000:1.0:1787833840.471551:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367271168 00000100:00100000:1.0:1787833840.471605:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 144 00000100:00100000:1.0:1787833840.471614:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477436940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+18:11355:x1874679367271168:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833840.471657:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833840.471677:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7756df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3c9c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833840.471804:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787833840.471930:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7756df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c9c expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.471944:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d800) 00010000:00010000:1.0:1787833840.471947:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833840.471952:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e7756df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c9c expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.471967:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198800, rc 0) 00000100:00100000:1.0:1787833840.472030:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477436940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+19:11355:x1874679367271168:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 417us (690us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787833840.472037:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 144 00000100:00100000:1.0:1787833840.475465:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.475553:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367271424 00000100:00100000:2.0:1787833840.475565:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367271424 00000100:00100000:2.0:1787833840.475623:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:2.0:1787833840.475632:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64777292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+19:11355:x1874679367271424:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833840.475910:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64777292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+20:11355:x1874679367271424:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 279us (456us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787833840.475917:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:2.0:1787833840.540981:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833840.541079:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367271552 00000100:00100000:0.0:1787833840.541112:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367271552 00000100:00100000:0.0:1787833840.541171:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 145 00000100:00100000:0.0:1787833840.541180:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+20:11361:x1874679367271552:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833840.541205:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833840.541225:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e7756ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ca3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.541310:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7756f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.541324:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7756f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.541384:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7756f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833840.541447:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787833840.541451:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833840.541472:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7756f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.541497:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e7756ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ca3 expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.541515:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7756f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ca3 expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.541523:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:0.0:1787833840.541526:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833840.541529:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751ee00, rc 0) 00000100:00100000:0.0:1787833840.541603:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6342377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+21:11361:x1874679367271552:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 423us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.541610:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 145 00000100:00100000:0.0:1787833840.549675:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833840.549770:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367271808 00000100:00100000:1.0:1787833840.549781:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367271808 00000100:00100000:1.0:1787833840.549847:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 146 00000100:00100000:1.0:1787833840.549857:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+21:11361:x1874679367271808:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833840.549879:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833840.549900:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7756fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3caa expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.549995:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775702 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.550024:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.550035:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833840.550047:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787833840.550189:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e7756fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3caa expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.550209:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3caa expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.550218:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279300) 00010000:00010000:1.0:1787833840.550221:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833840.550224:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198400, rc 0) 00000100:00100000:1.0:1787833840.550298:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+23:11361:x1874679367271808:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 442us (634us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787833840.550306:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 146 00000100:00100000:1.0:1787833840.555182:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833840.555299:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.555418:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367272192 00000100:00100000:2.0:1787833840.555428:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367272192 00000100:00100000:2.0:1787833840.555496:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787833840.555507:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+23:2345:x1874679367272192:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833840.555540:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833840.555569:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775702 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3caa expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.555588:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279300) 00010000:00010000:2.0:1787833840.555593:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833840.555657:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+22:2345:x1874679367272192:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 152us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833840.555665:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787833840.557581:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367272064 00000100:00100000:0.0:1787833840.557596:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367272064 00000100:00100000:0.0:1787833840.557696:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 147 00000100:00100000:0.0:1787833840.557707:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645288a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+22:11361:x1874679367272064:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833840.557733:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833840.557755:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3cb1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.557869:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775717 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.557887:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.557898:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775717 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833840.557910:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787833840.558032:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cb1 expref: 25 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.558050:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cb1 expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.558059:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279300) 00010000:00010000:0.0:1787833840.558073:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787833840.558077:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f600, rc 0) 00000100:00100000:0.0:1787833840.558163:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645288a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+24:11361:x1874679367272064:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 459us (3063us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787833840.558170:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 147 00000100:00100000:1.0:1787833840.564672:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.564747:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367272320 00000100:00100000:2.0:1787833840.564760:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367272320 00000100:00100000:2.0:1787833840.564832:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:2.0:1787833840.564843:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367272320:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:2.0:1787833840.564896:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.564916:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.564924:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833840.564929:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833840.564933:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.564991:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.565014:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 6 pid: 6660 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833840.565029:0:6661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6661:1874679375666432:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833840.565184:0:6661:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833840.571203:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.571278:0:6661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6661:1874679375666432:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833840.571309:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833840.571560:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367272448 00000100:00100000:0.0:1787833840.571567:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367272448 00002000:00100000:0.0:1787833840.571617:0:6664:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b64774343c0 x1874679367272448/t0(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:646/0 lens 504/0 e 0 to 0 dl 1787833851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833840.571627:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b64774343c0 with x1874679367272448 ext(0->12) 00010000:00010000:0.0:1787833840.571634:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 7 pid: 6660 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.571647:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 7 pid: 6660 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833840.571655:0:6664:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b64774343c0 00000100:00100000:0.0:1787833840.571689:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:0.0:1787833840.571699:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367272448:12345-192.168.202.15@tcp:4:lfs.0 00000100:00100000:0.0:1787833840.573146:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+9:2345:x1874679367272448:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 1438us (1941us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787833840.573159:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00002000:00100000:0.0:1787833840.573171:0:6664:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b64774343c0 x1874679367272448/t4294967305(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:646/0 lens 504/448 e 0 to 0 dl 1787833851 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833840.573181:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b64774343c0 with x1874679367272448 ext(0->12) 00010000:00010000:0.0:1787833840.573202:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 9 pid: 6660 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.573217:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 9 pid: 6660 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833840.573223:0:6664:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b64774343c0 00000100:00100000:3.0:1787833840.576593:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833840.576682:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367272576 00000100:00100000:1.0:1787833840.576692:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367272576 00010000:00010000:1.0:1787833840.576734:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 9 pid: 6660 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833840.576781:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:1.0:1787833840.576805:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2346:x1874679367272576:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833840.576822:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787833840.576842:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787833840.576846:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787833840 00002000:00010000:1.0:1787833840.576848:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787833840 00002000:00010000:1.0:1787833840.576850:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787833840 00010000:00010000:1.0:1787833840.576855:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 9 pid: 6660 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.576870:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 9 pid: 6660 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.576893:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010ab581a/0x2bdb54ee5e7756d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c95 expref: 9 pid: 6660 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.576912:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833840.576916:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833840.576923:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.576934:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833840.577025:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833840.577086:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+8:2346:x1874679367272576:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 282us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833840.577095:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00010000:00010000:0.0:1787833840.578546:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.578564:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.578600:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.578607:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.578616:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.578623:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833840.578627:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.578636:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.578668:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.578676:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775725 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833840.578805:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367272320:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 13960us (14141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.578814:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787833840.582939:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.583211:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367272832 00000100:00100000:2.0:1787833840.583224:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367272832 00000100:00100000:2.0:1787833840.583494:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:2.0:1787833840.583505:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f12050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+24:11361:x1874679367272832:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:2.0:1787833840.583570:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775717 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cb1 expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833840.583816:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787833840.583851:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787833840.584431:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787833840.584494:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.584511:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c87 expref: 28 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.584532:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.584568:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c87 expref: 28 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.584583:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c87 expref: 28 pid: 7195 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833840.584600:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1874679375666560:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833840.584684:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528fa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833840.589244:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.589639:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1874679375666560:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833840.589675:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833840.589851:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367272960 00000100:00100000:3.0:1787833840.589860:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367272960 00010000:00010000:3.0:1787833840.589903:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c87 expref: 29 pid: 7195 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833840.589944:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:3.0:1787833840.589955:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+29:2344:x1874679367272960:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833840.589969:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833840.589976:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c87 expref: 29 pid: 7195 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.589999:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c87 expref: 29 pid: 7195 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.590023:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7756c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c87 expref: 29 pid: 7195 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.590039:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279300) 00010000:00010000:3.0:1787833840.590044:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.590053:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.590062:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833840.590131:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833840.590189:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+28:2344:x1874679367272960:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 236us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833840.590196:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00010000:00010000:2.0:1787833840.593549:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.593571:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833840.593724:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787833840.594185:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787833840.594302:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874679375666688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787833840.594624:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833840.594703:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1787833840.594758:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375666688 00000100:00100000:0.0:1787833840.594838:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375666688 00000100:00100000:0.0:1787833840.594946:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787833840.594956:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1874679375666688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787833840.595041:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1874679375666688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.595049:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833840.595145:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874679375666688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787833840.595659:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787833840.595726:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874679375666816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787833840.595759:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833840.595792:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528fa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833840.595969:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375666816 00000100:00100000:0.0:1787833840.595974:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375666816 00000100:00100000:0.0:1787833840.596000:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787833840.596007:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1874679375666816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787833840.596174:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5819:x1874679375666816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 167us (413us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787833840.596182:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787833840.596306:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1874679375666816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787833840.596498:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787833840.596536:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.596545:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.596553:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.596559:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833840.596564:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.596572:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.596590:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279300) 00010000:00010000:2.0:1787833840.596593:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787833840.596599:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.596606:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77572c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787833840.596945:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787833840.597059:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787833840.597071:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319352730317ns, next at 320352727734ns, rc = 0 00000001:00080000:2.0:1787833840.597077:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787833840.597177:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279300) 00010000:00010000:2.0:1787833840.597180:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787833840.597187:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775717 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cb1 expref: 32 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833840.597305:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f12050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+31:11361:x1874679367272832:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 13800us (14375us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787833840.597314:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000020:00080000:2.0:1787833840.597319:0:5819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1787833840.599096:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787833840.600846:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.600937:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367273088 00000100:00100000:2.0:1787833840.600947:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367273088 00000100:00100000:2.0:1787833840.601010:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 148 00000100:00100000:2.0:1787833840.601020:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+31:11361:x1874679367273088:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833840.601042:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833840.601067:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775733 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3cb8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.601142:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775733 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cb8 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.601157:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775733 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cb8 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.601174:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:2.0:1787833840.601177:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833840.601194:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2800, rc 0) 00000100:00100000:2.0:1787833840.601259:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+32:11361:x1874679367273088:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 241us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833840.601266:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 148 00000100:00100000:3.0:1787833840.604382:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833840.604558:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367273344 00000100:00100000:1.0:1787833840.604568:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367273344 00000100:00100000:1.0:1787833840.604631:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:1.0:1787833840.604642:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477435680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+32:11361:x1874679367273344:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787833840.604904:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477435680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+33:11361:x1874679367273344:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 263us (584us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787833840.604912:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:1.0:1787833840.700694:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647783b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375667328:0@lo:400:kworker.0 00000100:00100000:1.0:1787833840.700788:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833840.700865:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787833840.700872:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f938780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375666944:0@lo:400:kworker.0 00000100:00100000:1.0:1787833840.700904:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833840.700929:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477839680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375667456:0@lo:400:kworker.0 00000100:00100000:1.0:1787833840.700955:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833840.700981:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477430780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375667200:0@lo:400:kworker.0 00000100:00100000:1.0:1787833840.701003:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833840.701019:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833840.701023:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375667072:0@lo:400:kworker.0 00000100:00100000:1.0:1787833840.701041:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833840.701066:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375666944 00000100:00100000:1.0:1787833840.701074:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375666944 00000100:00100000:1.0:1787833840.701134:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787833840.701144:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375666944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833840.701199:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375666944:12345-0@lo:400:kworker.0 Request processed in 57us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833840.701219:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787833840.701268:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f938780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375666944:0@lo:400:kworker.0 00000100:00100000:0.0:1787833840.701562:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375667328 00000100:00100000:0.0:1787833840.701573:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375667328 00000100:00100000:0.0:1787833840.701618:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787833840.701625:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375667328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833840.701665:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375667328:12345-0@lo:400:kworker.0 Request processed in 41us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.701671:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787833840.701690:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375667456 00000100:00100000:0.0:1787833840.701694:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375667456 00000100:00100000:0.0:1787833840.701715:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375667200 00000100:00100000:0.0:1787833840.701717:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375667200 00000100:00100000:0.0:1787833840.701728:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375667072 00000100:00100000:0.0:1787833840.701730:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375667072 00000100:00100000:0.0:1787833840.701741:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787833840.701747:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375667456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833840.701787:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375667456:12345-0@lo:400:kworker.0 Request processed in 40us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.701793:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787833840.701804:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787833840.701809:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375667200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833840.701840:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375667200:12345-0@lo:400:kworker.0 Request processed in 31us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.701846:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787833840.701857:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787833840.701862:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375667072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833840.701885:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375667072:12345-0@lo:400:kworker.0 Request processed in 24us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.701891:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787833840.701926:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375667072:0@lo:400:kworker.0 00000100:00100000:0.0:1787833840.701937:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477430780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375667200:0@lo:400:kworker.0 00000100:00100000:1.0:1787833840.707605:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477839680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375667456:0@lo:400:kworker.0 00000100:00100000:1.0:1787833840.707626:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647783b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375667328:0@lo:400:kworker.0 00000100:00080000:1.0:1787833840.707668:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833840.707674:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833840.717844:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833840.718210:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367273600 00000100:00100000:0.0:1787833840.718222:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367273600 00000100:00100000:0.0:1787833840.718293:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 149 00000100:00100000:0.0:1787833840.718302:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+33:11371:x1874679367273600:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833840.718337:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833840.718397:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77573a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3cbf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833840.718523:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787833840.718652:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77573a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cbf expref: 35 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.718667:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d800) 00010000:00010000:0.0:1787833840.718669:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787833840.718675:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77573a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cbf expref: 35 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.718688:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e000, rc 0) 00000100:00100000:0.0:1787833840.718757:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+34:11371:x1874679367273600:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 456us (926us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787833840.718774:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 149 00000100:00100000:3.0:1787833840.728202:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833840.728496:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367273728 00000100:00100000:2.0:1787833840.728508:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367273728 00000100:00100000:2.0:1787833840.728585:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 150 00000100:00100000:2.0:1787833840.728598:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477434f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+34:11371:x1874679367273728:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787833840.728732:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.728754:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.728776:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.728795:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.728802:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.728809:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.728934:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.728942:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.728974:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833840.729022:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729039:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729046:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729052:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729058:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833840.729063:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729071:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729084:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:2.0:1787833840.729088:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833840.729092:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729109:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775748 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729126:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729139:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729145:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729150:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833840.729153:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729160:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729169:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6474279300) 00010000:00010000:2.0:1787833840.729172:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833840.729175:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729180:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e77574f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729196:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729202:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729209:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729213:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833840.729222:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729228:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729236:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:2.0:1787833840.729239:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833840.729242:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833840.729247:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e775756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833840.729930:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477434f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+34:11371:x1874679367273728:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1330us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833840.729942:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 150 00000100:00100000:3.0:1787833840.732584:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833840.732743:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367273984 00000100:00100000:1.0:1787833840.732752:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367273984 00000100:00100000:1.0:1787833840.732819:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:1.0:1787833840.732829:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+34:11371:x1874679367273984:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787833840.733126:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+35:11371:x1874679367273984:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 297us (552us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787833840.733134:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:1.0:1787833840.784858:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833840.784951:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367274240 00000100:00100000:0.0:1787833840.784963:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367274240 00000100:00100000:0.0:1787833840.785029:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 151 00000100:00100000:0.0:1787833840.785040:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+35:11374:x1874679367274240:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833840.785088:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833840.785126:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77575d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3cc6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785218:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785233:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785243:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785255:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785261:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785280:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785471:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785480:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785486:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833840.785497:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787833840.785612:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785619:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785625:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785631:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fc00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833840.785636:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785644:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785657:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:0.0:1787833840.785660:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833840.785664:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785671:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785683:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785689:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785695:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785710:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833840.785712:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785719:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785727:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b646021da00) 00010000:00010000:0.0:1787833840.785729:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833840.785731:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785736:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77576b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785777:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77575d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cc6 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785790:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cc6 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.785796:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:0.0:1787833840.785799:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833840.785801:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e800, rc 0) 00000100:00100000:0.0:1787833840.785871:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+37:11374:x1874679367274240:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 832us (1023us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787833840.785878:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 151 00000100:00100000:3.0:1787833840.789724:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833840.789810:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367274368 00000100:00100000:0.0:1787833840.789833:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367274368 00000100:00100000:0.0:1787833840.789889:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:0.0:1787833840.789898:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477437840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+37:11374:x1874679367274368:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:0.0:1787833840.789966:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.789984:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.789996:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.790022:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.790029:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.790037:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.790043:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833840.790047:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.790054:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.790065:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:0.0:1787833840.790068:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787833840.790072:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833840.790087:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833840.790165:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477437840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+37:11374:x1874679367274368:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 267us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833840.790172:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:3.0:1787833840.792423:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833840.792539:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367274624 00000100:00100000:1.0:1787833840.792548:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367274624 00000100:00100000:1.0:1787833840.792606:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:1.0:1787833840.792616:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+37:11374:x1874679367274624:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787833840.792851:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+38:11374:x1874679367274624:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 237us (435us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787833840.792858:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00010000:00010000:2.0:1787833840.956619:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833841.105747:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833841.105836:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367274880 00000100:00100000:0.0:1787833841.105846:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367274880 00000100:00100000:0.0:1787833841.105901:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 153 00000100:00100000:0.0:1787833841.105909:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+38:11405:x1874679367274880:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:0.0:1787833841.105930:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833841.105951:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775787 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ccd expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.106063:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77578e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.106077:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77578e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.106089:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77578e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833841.106110:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787833841.106225:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775787 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ccd expref: 41 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.106242:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77578e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ccd expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.106262:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:0.0:1787833841.106266:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833841.106270:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e000, rc 0) 00000100:00100000:0.0:1787833841.106335:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+40:11405:x1874679367274880:12345-192.168.202.15@tcp:101:cat.0 Request processed in 426us (597us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787833841.106399:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 153 00000100:00100000:3.0:1787833841.113607:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833841.113712:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367275008 00000100:00100000:2.0:1787833841.113722:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367275008 00000100:00100000:2.0:1787833841.113797:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787833841.113808:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+40:2346:x1874679367275008:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833841.113827:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833841.113853:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e77578e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ccd expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.113872:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:2.0:1787833841.113877:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833841.113937:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+39:2346:x1874679367275008:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 132us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.113962:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787833841.117184:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833841.117307:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367275264 00000100:00100000:1.0:1787833841.117322:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367275264 00000100:00100000:1.0:1787833841.117421:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787833841.117432:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+39:11405:x1874679367275264:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:1.0:1787833841.117669:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+40:11405:x1874679367275264:12345-192.168.202.15@tcp:35:cat.0 Request processed in 238us (496us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787833841.117677:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787833841.190652:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833841.190767:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367275520 00000100:00100000:0.0:1787833841.190778:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367275520 00000100:00100000:0.0:1787833841.190841:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 154 00000100:00100000:0.0:1787833841.190851:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+40:11411:x1874679367275520:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:0.0:1787833841.190875:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833841.190878:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787833841.190905:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7756f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ca3 expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.190923:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:0.0:1787833841.190929:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833841.190941:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e77579c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3cd4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.191033:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.191047:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cc6 expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.191070:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.191102:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cc6 expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.191116:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cc6 expref: 40 pid: 5815 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833841.191131:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647783a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375667584:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833841.191222:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833841.195894:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647783a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375667584:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833841.195928:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833841.198239:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833841.198417:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367275648 00000100:00100000:2.0:1787833841.198436:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367275648 00010000:00010000:2.0:1787833841.198476:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cc6 expref: 41 pid: 5815 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833841.198516:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:2.0:1787833841.198525:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446009050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+41:2344:x1874679367275648:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833841.198539:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833841.198545:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cc6 expref: 41 pid: 5815 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.198557:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cc6 expref: 41 pid: 5815 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.198578:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cc6 expref: 41 pid: 5815 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.198592:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:2.0:1787833841.198597:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.198605:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.198612:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.198660:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833841.198716:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446009050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+40:2344:x1874679367275648:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 191us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.198724:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00010000:00010000:0.0:1787833841.198886:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.198896:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833841.198915:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787833841.199067:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e77579c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cd4 expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.199083:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cd4 expref: 40 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.199103:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:0.0:1787833841.199106:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787833841.199109:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e200, rc 0) 00000100:00100000:0.0:1787833841.199135:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+40:11411:x1874679367275520:12345-192.168.202.15@tcp:101:dd.0 Request processed in 8286us (8494us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787833841.199141:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 154 00000100:00100000:3.0:1787833841.203637:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833841.203716:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367275904 00000100:00100000:0.0:1787833841.203727:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367275904 00000100:00100000:0.0:1787833841.203798:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 155 00000100:00100000:0.0:1787833841.203807:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+40:11411:x1874679367275904:12345-192.168.202.15@tcp:36:dd.0 00010000:00010000:0.0:1787833841.204088:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.204106:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.204119:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833841.204175:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787833841.204199:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098d122d3 reply state 00000000bef10ca9 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833841.204208:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833841.204309:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+43:11411:x1874679367275904:12345-192.168.202.15@tcp:36:dd.0 Request processed in 502us (885us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787833841.204326:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 155 00000020:00080000:0.0:1787833841.204380:0:5815:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787833841.207789:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.207806:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.207814:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.207821:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ee00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833841.207826:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.207835:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.207854:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:1.0:1787833841.207857:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833841.207862:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.207868:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7757b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833841.212605:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833841.212629:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64778dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375667712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833841.212704:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833841.212795:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375667712 00000100:00100000:1.0:1787833841.212802:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375667712 00000100:00100000:1.0:1787833841.212860:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787833841.212870:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874679375667712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833841.212894:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833841.212949:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1874679375667712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833841.212957:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787833841.213038:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64778dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375667712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833841.456106:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833841.456173:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367276032 00000100:00100000:2.0:1787833841.456184:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367276032 00000100:00100000:2.0:1787833841.456516:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 156 00000100:00100000:2.0:1787833841.456529:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477435e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+42:11426:x1874679367276032:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:2.0:1787833841.456556:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833841.456579:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7757b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3cdb expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456652:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456667:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456679:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456692:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456699:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456705:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456844:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456857:0:7195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cd4 expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456865:0:7195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456907:0:7195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cd4 expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.456923:0:7195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cd4 expref: 43 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833841.456945:0:7195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375667840:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833841.457056:0:7195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528fa480 going to sleep for 11 seconds 00000100:00100000:3.0:1787833841.459710:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833841.459786:0:7195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375667840:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833841.459791:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367276288 00000100:00100000:1.0:1787833841.459799:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367276288 00010000:00010000:2.0:1787833841.459817:0:7195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833841.459848:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:1.0:1787833841.459857:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477434780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+44:5586:x1874679367276288:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787833841.460224:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477434780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+45:5586:x1874679367276288:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 367us (524us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787833841.460232:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787833841.464478:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833841.464903:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367276416 00000100:00100000:1.0:1787833841.464917:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367276416 00010000:00010000:1.0:1787833841.464972:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cd4 expref: 45 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833841.465012:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:1.0:1787833841.465021:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477435a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+45:2345:x1874679367276416:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833841.465033:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833841.465039:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cd4 expref: 45 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.465072:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cd4 expref: 45 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.465097:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e7757a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cd4 expref: 45 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.465116:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:1.0:1787833841.465121:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.465131:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.465139:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.465169:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833841.465194:0:7195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465202:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833841.465231:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477435a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+44:2345:x1874679367276416:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 212us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833841.465239:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00000004:00200000:2.0:1787833841.465248:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787833841.465258:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833841.465481:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465496:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465508:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465514:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465520:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465525:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833841.465530:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465537:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465546:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:2.0:1787833841.465549:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833841.465662:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465669:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e7757bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465681:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465697:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465702:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465707:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833841.465710:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465716:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465724:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6474279300) 00010000:00010000:2.0:1787833841.465726:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833841.465729:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.465734:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e7757c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.467043:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7757b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cdb expref: 44 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.467069:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cdb expref: 43 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.467078:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:2.0:1787833841.467080:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833841.467096:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3c00, rc 0) 00000100:00100000:2.0:1787833841.467219:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477435e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+43:11426:x1874679367276032:12345-192.168.202.15@tcp:101:stat.0 Request processed in 10691us (11123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833841.467228:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 156 00000100:00100000:3.0:1787833841.524640:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833841.524765:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367276672 00000100:00100000:0.0:1787833841.524775:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367276672 00000100:00100000:0.0:1787833841.524837:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 157 00000100:00100000:0.0:1787833841.524847:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477434b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+43:11432:x1874679367276672:12345-192.168.202.15@tcp:36:truncate.0 00010000:00010000:0.0:1787833841.524905:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833841.524934:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e7757cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cdb expref: 43 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.524954:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:0.0:1787833841.524959:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833841.525180:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.525194:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.525204:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833841.525253:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787833841.525276:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a541f747 reply state 00000000b66d2337 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833841.525285:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833841.525948:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477434b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+45:11432:x1874679367276672:12345-192.168.202.15@tcp:36:truncate.0 Request processed in 1098us (1314us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787833841.525958:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 157 00000020:00080000:1.0:1787833841.525964:0:5815:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787833841.528539:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.528556:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.528577:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.528583:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833841.528588:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.528597:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.528616:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:1.0:1787833841.528619:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833841.528623:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.528629:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e7757d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833841.689057:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833841.689292:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367276800 00000100:00100000:1.0:1787833841.689302:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367276800 00000100:00100000:1.0:1787833841.689401:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 158 00000100:00100000:1.0:1787833841.689412:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477437c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+44:11446:x1874679367276800:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:1.0:1787833841.689435:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833841.689455:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7757db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ce2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689532:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689545:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689570:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689585:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689591:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689597:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689689:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689698:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689705:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833841.689740:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787833841.689744:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833841.689763:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689775:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689783:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689800:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689806:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689812:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833841.689816:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689823:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689836:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833841.689839:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833841.689843:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689849:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7757e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689863:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689870:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689876:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.689881:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833841.690277:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.690287:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.690297:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6451e01600) 00010000:00010000:1.0:1787833841.690299:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833841.690303:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.690308:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7757e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.690386:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e7757db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce2 expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.690401:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce2 expref: 45 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.690408:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:1.0:1787833841.690410:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833841.690412:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199200, rc 0) 00000100:00100000:1.0:1787833841.691639:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477437c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+45:11446:x1874679367276800:12345-192.168.202.15@tcp:101:stat.0 Request processed in 2221us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833841.691651:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 158 00000001:00080000:0.0:1787833841.786404:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1787833841.786421:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1787833841.805259:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833841.805461:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367277056 00000100:00100000:2.0:1787833841.805471:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367277056 00000100:00100000:2.0:1787833841.805538:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 159 00000100:00100000:2.0:1787833841.805549:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+45:11456:x1874679367277056:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833841.805573:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833841.805597:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7757f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ce9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833841.805719:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787833841.805836:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7757f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce9 expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.805851:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d800) 00010000:00010000:2.0:1787833841.805854:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833841.805860:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7757f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce9 expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833841.805874:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3000, rc 0) 00000100:00100000:2.0:1787833841.805940:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+46:11456:x1874679367277056:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 393us (693us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787833841.805947:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 159 00000100:00100000:3.0:1787833841.809043:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833841.809174:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367277312 00000100:00100000:2.0:1787833841.809183:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367277312 00000100:00100000:2.0:1787833841.809241:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:2.0:1787833841.809267:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f10050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+46:11456:x1874679367277312:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833841.809563:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f10050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+47:11456:x1874679367277312:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 297us (529us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787833841.809571:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:2.0:1787833841.896553:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833841.896668:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367277568 00000100:00100000:0.0:1787833841.896678:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367277568 00000100:00100000:0.0:1787833841.896748:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 160 00000100:00100000:0.0:1787833841.896765:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+47:11462:x1874679367277568:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787833841.896787:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833841.896808:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775805 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3cf0 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.896906:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.896922:0:7195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce2 expref: 48 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.896930:0:7195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.896978:0:7195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce2 expref: 48 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.896990:0:7195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce2 expref: 48 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833841.897003:0:7195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647783b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375667968:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833841.897097:0:7195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833841.903812:0:7195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647783b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375667968:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833841.903841:0:7195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833841.906444:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833841.907331:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367277696 00000100:00100000:1.0:1787833841.907378:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367277696 00010000:00010000:1.0:1787833841.907425:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce2 expref: 49 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833841.908936:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:1.0:1787833841.908969:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+49:2344:x1874679367277696:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833841.909050:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833841.909061:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce2 expref: 49 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.909079:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce2 expref: 49 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.909105:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e7757f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ce2 expref: 49 pid: 5817 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.909122:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:1.0:1787833841.909129:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.909139:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.909147:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.909182:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833841.909236:0:7195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833841.909251:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+48:2344:x1874679367277696:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 297us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833841.909265:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00010000:00010000:0.0:1787833841.911937:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833841.911979:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787833841.912154:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775805 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf0 expref: 49 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.912176:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf0 expref: 48 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.912184:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:0.0:1787833841.912187:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787833841.912191:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e400, rc 0) 00000100:00100000:0.0:1787833841.912486:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+48:11462:x1874679367277568:12345-192.168.202.15@tcp:101:bash.0 Request processed in 15721us (15941us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787833841.912495:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 160 00000100:00100000:2.0:1787833841.915952:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833841.916110:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367277952 00000100:00100000:0.0:1787833841.916120:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367277952 00000100:00100000:0.0:1787833841.916211:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 161 00000100:00100000:0.0:1787833841.916223:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+48:11462:x1874679367277952:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:0.0:1787833841.916542:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.916559:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.916571:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833841.916639:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787833841.916664:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff5f8903 reply state 000000004acc01e6 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833841.916674:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833841.919019:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+51:11462:x1874679367277952:12345-192.168.202.15@tcp:36:bash.0 Request processed in 2787us (3065us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787833841.919032:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 161 00000020:00080000:0.0:1787833841.919039:0:5816:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787833841.924225:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.924244:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.924252:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.924258:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fe00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833841.924262:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.924280:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.924300:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:0.0:1787833841.924303:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833841.924307:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.924322:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77581a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833841.925516:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833841.925732:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367278080 00000100:00100000:1.0:1787833841.925756:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367278080 00000100:00100000:1.0:1787833841.925812:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00100000:1.0:1787833841.925823:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+50:11462:x1874679367278080:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787833841.925847:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833841.925865:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775821 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3cf7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.925949:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.925962:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf0 expref: 51 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.925969:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.926000:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf0 expref: 51 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833841.926013:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf0 expref: 51 pid: 7195 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833841.926026:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64778dcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375668096:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833841.926107:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e300 going to sleep for 11 seconds 00000100:00100000:1.0:1787833841.930195:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833841.930301:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64778dcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375668096:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833841.930335:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833841.930473:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367278208 00000100:00100000:3.0:1787833841.930480:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367278208 00010000:00010000:3.0:1787833841.930518:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf0 expref: 52 pid: 7195 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833841.930546:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:3.0:1787833841.930555:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+52:2344:x1874679367278208:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833841.930570:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833841.930576:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf0 expref: 52 pid: 7195 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833841.930589:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf0 expref: 52 pid: 7195 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833841.930612:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e77580c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf0 expref: 52 pid: 7195 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833841.930626:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:3.0:1787833841.930630:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833841.930657:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833841.930665:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833841.930693:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833841.930758:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+51:2344:x1874679367278208:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 194us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833841.930767:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00010000:00010000:0.0:1787833841.931652:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.931664:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833841.931711:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787833841.931716:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833841.931737:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.931781:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf7 expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.931797:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf7 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833841.931804:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:0.0:1787833841.931807:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787833841.931809:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198c00, rc 0) 00000100:00100000:0.0:1787833841.931857:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+50:11462:x1874679367278080:12345-192.168.202.15@tcp:101:bash.0 Request processed in 6036us (6348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833841.931865:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00100000:1.0:1787833841.939402:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833841.939496:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367278464 00000100:00100000:2.0:1787833841.939506:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367278464 00000100:00100000:2.0:1787833841.939562:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:2.0:1787833841.939573:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+50:11462:x1874679367278464:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:2.0:1787833841.939823:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+51:11462:x1874679367278464:12345-192.168.202.15@tcp:35:bash.0 Request processed in 251us (431us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787833841.939830:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00010000:00010000:0.0:1787833841.980634:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833842.035619:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833842.037120:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367278720 00000100:00100000:1.0:1787833842.037132:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367278720 00000100:00080000:0.0:1787833842.037207:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833842.037221:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 163 00000100:00100000:1.0:1787833842.037249:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477435680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+51:11472:x1874679367278720:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833842.037276:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833842.037298:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77582f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3cfe expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833842.037461:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787833842.037580:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77582f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cfe expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.037597:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d800) 00010000:00010000:1.0:1787833842.037600:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833842.037606:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e77582f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cfe expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.037621:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199a00, rc 0) 00000100:00100000:1.0:1787833842.037688:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477435680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+52:11472:x1874679367278720:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 443us (2079us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787833842.037697:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 163 00000100:00100000:0.0:1787833842.040150:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833842.042986:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367278848 00000100:00100000:1.0:1787833842.043002:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367278848 00000100:00100000:1.0:1787833842.043081:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:1.0:1787833842.043098:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477839680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+52:11472:x1874679367278848:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:1.0:1787833842.043169:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043186:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043214:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043229:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043236:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043242:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043372:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043390:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043397:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833842.043441:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043453:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043459:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043465:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043482:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833842.043487:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043495:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043508:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833842.043511:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833842.043516:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043522:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e77583d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043535:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043541:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043546:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043552:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833842.043554:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043559:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043576:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6451e01200) 00010000:00010000:1.0:1787833842.043579:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833842.043582:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043588:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775844 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043602:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043607:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043613:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043618:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833842.043620:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043625:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043646:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:1.0:1787833842.043649:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833842.043652:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.043657:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e77584b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833842.043753:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477839680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+52:11472:x1874679367278848:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 657us (3619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833842.043761:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:0.0:1787833842.047897:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833842.048157:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367279104 00000100:00100000:2.0:1787833842.048170:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367279104 00000100:00100000:2.0:1787833842.048231:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:2.0:1787833842.048242:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647783b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+52:11472:x1874679367279104:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833842.048552:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647783b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+53:11472:x1874679367279104:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 313us (666us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787833842.048575:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787833842.084188:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833842.084272:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367279360 00000100:00100000:1.0:1787833842.084284:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367279360 00000100:00100000:1.0:1787833842.084394:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:1.0:1787833842.084406:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+53:11475:x1874679367279360:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833842.084431:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833842.084452:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775852 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084530:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084545:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084557:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084572:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084580:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084586:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084737:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084747:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084755:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833842.084766:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787833842.084859:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084868:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084875:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084882:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833842.084887:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084895:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084907:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833842.084910:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833842.084915:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084931:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775859 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084945:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084952:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084958:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084963:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833842.084966:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084972:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.084981:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6451e01200) 00010000:00010000:1.0:1787833842.084997:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833842.085000:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.085006:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775860 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.085048:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775852 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d05 expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.085062:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d05 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.085318:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:1.0:1787833842.085321:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833842.085324:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199a00, rc 0) 00000100:00100000:0.0:1787833842.085537:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+55:11475:x1874679367279360:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1132us (1357us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787833842.085546:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:0.0:1787833842.093284:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833842.094216:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367279488 00000100:00100000:1.0:1787833842.094228:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367279488 00000100:00100000:1.0:1787833842.094298:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:1.0:1787833842.094310:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477430780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+55:11475:x1874679367279488:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:1.0:1787833842.094433:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.094452:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.094465:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.094495:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.094503:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.094509:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.094515:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833842.094519:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.094546:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.094559:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:1.0:1787833842.094562:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833842.094569:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.094574:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833842.094675:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477430780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+55:11475:x1874679367279488:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 366us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833842.094685:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:1.0:1787833842.099229:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833842.099320:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367279616 00000100:00100000:2.0:1787833842.099331:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367279616 00000100:00100000:2.0:1787833842.099442:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:2.0:1787833842.099454:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778de940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+55:2345:x1874679367279616:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833842.099473:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833842.099503:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d05 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833842.099527:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:2.0:1787833842.099533:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833842.099595:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833842.099598:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778de940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+54:2345:x1874679367279616:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 145us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833842.099607:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787833842.099764:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367279872 00000100:00100000:1.0:1787833842.099768:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367279872 00000100:00100000:1.0:1787833842.099805:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787833842.099814:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+54:11475:x1874679367279872:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787833842.100195:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+55:11475:x1874679367279872:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 383us (601us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787833842.100204:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:0.0:1787833842.263442:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833842.263682:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367280128 00000100:00100000:2.0:1787833842.263703:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367280128 00000100:00100000:2.0:1787833842.263757:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:2.0:1787833842.263765:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+55:11493:x1874679367280128:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:2.0:1787833842.263786:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833842.263804:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77587c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d0c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833842.263894:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775883 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833842.263906:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775883 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833842.263928:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775883 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833842.263937:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787833842.264059:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e77587c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d0c expref: 58 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833842.264080:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775883 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d0c expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833842.264088:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:2.0:1787833842.264092:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787833842.264095:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2000, rc 0) 00000100:00100000:2.0:1787833842.264271:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+57:11493:x1874679367280128:12345-192.168.202.15@tcp:101:cat.0 Request processed in 506us (838us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787833842.264277:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:0.0:1787833842.291677:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833842.291776:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367280256 00000100:00100000:1.0:1787833842.291784:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367280256 00000100:00100000:1.0:1787833842.291834:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:1.0:1787833842.291843:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+57:11494:x1874679367280256:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833842.291866:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833842.291896:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775891 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d13 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.291973:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775898 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.291986:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.291998:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833842.292054:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787833842.292057:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833842.292075:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.292100:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775891 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d13 expref: 59 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.292117:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775898 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d13 expref: 58 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.292125:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833842.292128:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833842.292131:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198800, rc 0) 00000100:00100000:1.0:1787833842.292188:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+58:11494:x1874679367280256:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 347us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833842.292195:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:3.0:1787833842.299957:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833842.301208:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367280640 00000100:00100000:2.0:1787833842.301221:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367280640 00000100:00100000:2.0:1787833842.301650:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787833842.301662:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+58:11494:x1874679367280640:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833842.302029:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+59:11494:x1874679367280640:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 369us (2083us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787833842.302038:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:0.0:1787833842.304170:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833842.304426:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367280768 00000100:00100000:3.0:1787833842.304436:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367280768 00000100:00100000:3.0:1787833842.304500:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787833842.304509:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+59:11494:x1874679367280768:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:3.0:1787833842.304524:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787833842.304551:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775828 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cf7 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833842.304572:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2000/0x2bdb54ee5e775883 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d0c expref: 58 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833842.304584:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775733 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3cb8 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833842.304614:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:3.0:1787833842.304627:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833842.304680:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+56:11494:x1874679367280768:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 172us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833842.304688:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:0.0:1787833842.306415:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833842.306632:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367280896 00000100:00100000:3.0:1787833842.306641:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367280896 00000100:00100000:3.0:1787833842.306698:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:3.0:1787833842.306708:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+56:11494:x1874679367280896:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:3.0:1787833842.306822:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833842.306840:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833842.306852:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833842.307045:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787833842.307127:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+56:11494:x1874679367280896:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 419us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833842.307135:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:3.0:1787833842.330290:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833842.330985:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367281024 00000100:00100000:1.0:1787833842.331005:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367281024 00000100:00100000:1.0:1787833842.331073:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 170 00000100:00100000:1.0:1787833842.331084:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+56:11496:x1874679367281024:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833842.331109:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833842.331136:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7758a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d1a expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331222:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331238:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331251:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331582:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331594:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331601:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331701:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331710:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331716:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833842.331931:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787833842.331937:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833842.331961:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331975:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331983:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331989:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.331995:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332001:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833842.332005:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332012:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332025:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833842.332028:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833842.332033:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332039:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332069:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332075:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332081:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332086:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833842.332089:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332095:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332103:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6451e01200) 00010000:00010000:1.0:1787833842.332106:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833842.332109:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332114:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e7758b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332151:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e7758a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d1a expref: 58 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332177:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d1a expref: 57 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833842.332196:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3800) 00010000:00010000:1.0:1787833842.332199:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833842.332201:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198c00, rc 0) 00000100:00100000:1.0:1787833842.332521:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+57:11496:x1874679367281024:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1437us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833842.332529:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 170 00000100:00100000:3.0:1787833842.863817:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833842.863862:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833842.863873:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367281280 00000100:00100000:1.0:1787833842.863882:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367281280 00000100:00100000:3.0:1787833842.863903:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833842.863929:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833842.863950:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367281408 00000100:00100000:1.0:1787833842.863953:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367281408 00000100:00100000:3.0:1787833842.863977:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367281152 00000100:00100000:1.0:1787833842.863979:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:3.0:1787833842.863980:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367281152 00000100:00100000:1.0:1787833842.863989:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477434780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367281280:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833842.864005:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 293 00000100:00100000:3.0:1787833842.864011:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367281152:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833842.864064:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477434780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367281280:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 77us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833842.864072:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:2.0:1787833842.864078:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367281536 00000100:00100000:2.0:1787833842.864081:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367281536 00000100:00100000:1.0:1787833842.864089:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:1.0:1787833842.864095:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+5:2344:x1874679367281408:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833842.864114:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 148 00000100:00100000:2.0:1787833842.864122:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367281536:12345-192.168.202.15@tcp:400:kworker.0 00000100:00080000:0.0:1787833842.865308:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833842.865317:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787833842.865320:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833842.868698:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367281152:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 4671us (4778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833842.868714:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 293 00000100:00100000:1.0:1787833842.871080:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+5:2344:x1874679367281408:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 6971us (7137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833842.871095:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:2.0:1787833842.883545:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2344:x1874679367281536:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 19412us (19670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833842.883561:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 148 00010000:00010000:1.0:1787833843.004560:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787833843.083668:0:12489:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787833843.083679:0:12489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787833843.083736:0:12489:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787833843.089594:0:12489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787833843.138008:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833843.138015:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833843.138046:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787833843.138052:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833843.138162:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca5680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375668224:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787833843.138246:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647424f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833843.142282:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833843.144135:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367281664 00000100:00100000:3.0:1787833843.144150:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367281664 00000100:00100000:3.0:1787833843.144229:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:3.0:1787833843.144240:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367281664:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787833843.144283:0:5817:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787833843.144452:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367281664:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 213us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833843.144460:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:1.0:1787833843.151018:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833843.151155:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367281792 00000100:00100000:3.0:1787833843.151167:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367281792 00000100:00100000:3.0:1787833843.151239:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:3.0:1787833843.151250:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367281792:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787833843.153507:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153532:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153554:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153572:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153580:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153586:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153613:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153622:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153628:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833843.153667:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787833843.153672:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833843.153684:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153695:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153703:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153720:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153726:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.153730:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153738:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153751:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:3.0:1787833843.153755:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833843.153760:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153766:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e7758c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153778:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153784:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153789:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153795:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.153798:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153815:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153823:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833843.153825:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833843.153828:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153833:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e7758c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153848:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153854:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153858:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153863:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.153866:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153870:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153877:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3800) 00010000:00010000:3.0:1787833843.153879:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833843.153881:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.153895:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7758d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.153991:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367281792:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 2739us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833843.154001:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:2.0:1787833843.155632:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca5680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375668224:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787833843.163405:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833843.163514:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367282048 00000100:00100000:3.0:1787833843.163523:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367282048 00000100:00100000:3.0:1787833843.163585:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:3.0:1787833843.163595:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+57:11508:x1874679367282048:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833843.163617:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833843.163639:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7758d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d21 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.163758:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.163774:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.163785:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833843.163795:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787833843.163901:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.163909:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.163932:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.163939:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440030a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.163943:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.163952:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.163965:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3800) 00010000:00010000:3.0:1787833843.163968:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833843.163972:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.163978:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7758de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.164023:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7758d7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d21 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.164033:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:3.0:1787833843.164035:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833843.164039:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7758d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d21 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.164049:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2ca00, rc 0) 00000100:00100000:3.0:1787833843.164112:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367282048:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 519us (717us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787833843.164128:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:3.0:1787833843.180377:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833843.180643:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367282176 00000100:00100000:2.0:1787833843.180653:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367282176 00000100:00100000:2.0:1787833843.180711:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:2.0:1787833843.180721:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477436580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367282176:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787833843.180756:0:5816:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787833843.180873:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477436580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367282176:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 153us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833843.180881:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:3.0:1787833843.184432:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833843.185121:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367282432 00000100:00100000:1.0:1787833843.185132:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367282432 00000100:00100000:1.0:1787833843.185205:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:1.0:1787833843.185226:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367282432:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833843.185245:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833843.185249:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787833843.185500:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775898 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d13 expref: 58 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.185520:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833843.185524:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787833843.185538:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d28 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787833843.186643:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787833843.187205:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7758f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.187225:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7758f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.187238:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7758f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.187328:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e7758ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d28 expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.187377:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7758f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d28 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.187385:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6451e01200) 00010000:00010000:1.0:1787833843.187388:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833843.187402:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199a00, rc 0) 00000100:00100000:1.0:1787833843.187476:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+59:11508:x1874679367282432:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2252us (3054us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787833843.187486:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:3.0:1787833843.194615:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833843.194660:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367282688 00000100:00100000:3.0:1787833843.194670:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367282688 00000100:00100000:3.0:1787833843.194724:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:3.0:1787833843.194733:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+59:11508:x1874679367282688:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787833843.194805:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833843.194836:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e7758f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d28 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.194854:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6451e01200) 00010000:00010000:3.0:1787833843.194864:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833843.194888:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.194902:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.194912:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.194927:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.194935:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.194961:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195032:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195040:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195048:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195054:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.195059:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195067:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195077:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:3.0:1787833843.195080:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833843.195084:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195091:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775901 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195101:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195108:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195120:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195126:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440030a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.195129:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195137:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195145:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x739e386f (ffff9b645a7d3300) 00010000:00010000:3.0:1787833843.195148:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833843.195151:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.195158:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775908 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x739e386f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.195237:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367282688:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 503us (633us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787833843.195245:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:2.0:1787833843.203066:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833843.203146:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367282816 00000100:00100000:0.0:1787833843.203156:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367282816 00000100:00100000:0.0:1787833843.203217:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:0.0:1787833843.203226:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+58:11508:x1874679367282816:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833843.203248:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833843.203270:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e77590f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d2f expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.203314:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.203329:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.203379:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.203474:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e77590f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d2f expref: 60 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.203491:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d2f expref: 59 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.203500:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:0.0:1787833843.203503:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787833843.203506:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751fc00, rc 0) 00000100:00100000:0.0:1787833843.203570:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+59:11508:x1874679367282816:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 344us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833843.203577:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:3.0:1787833843.206678:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833843.206758:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367283072 00000100:00100000:0.0:1787833843.206768:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367283072 00000100:00100000:0.0:1787833843.206829:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 178 00000100:00100000:0.0:1787833843.206840:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+59:11508:x1874679367283072:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833843.206919:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.206937:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.206952:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833843.207281:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1787833843.207292:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321962951106ns, next at 322962948314ns, rc = 0 00000004:00010000:0.0:1787833843.207426:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a9be321 reply state 00000000c95d9dfb transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833843.207436:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833843.207533:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+61:11508:x1874679367283072:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 693us (863us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787833843.207540:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 178 00010000:00010000:3.0:1787833843.209956:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.209977:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.209984:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.210009:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.210014:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.210023:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.210041:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:3.0:1787833843.210044:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787833843.210048:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.210054:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e77591d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.217707:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833843.217785:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367283200 00000100:00100000:0.0:1787833843.217795:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367283200 00000100:00100000:0.0:1787833843.217855:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 179 00000100:00100000:0.0:1787833843.217866:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+60:11508:x1874679367283200:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833843.217890:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833843.217910:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d36 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.217970:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d36 expref: 61 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.217984:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d36 expref: 61 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.218003:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:0.0:1787833843.218006:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833843.218011:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751ec00, rc 0) 00000100:00100000:0.0:1787833843.218088:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+61:11508:x1874679367283200:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 224us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833843.218096:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 179 00000100:00100000:3.0:1787833843.220561:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833843.220646:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367283328 00000100:00100000:0.0:1787833843.220655:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367283328 00000100:00100000:0.0:1787833843.220716:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:0.0:1787833843.220725:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367283328:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787833843.221077:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367283328:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 352us (522us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787833843.221086:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:0.0:1787833843.223390:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833843.223480:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367283584 00000100:00100000:3.0:1787833843.223488:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367283584 00000100:00100000:3.0:1787833843.223552:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:3.0:1787833843.223563:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+61:11508:x1874679367283584:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787833843.223821:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+62:11508:x1874679367283584:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 260us (439us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787833843.223829:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787833843.225942:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833843.226118:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367283840 00000100:00100000:3.0:1787833843.226127:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367283840 00000100:00100000:3.0:1787833843.226176:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 180 00000100:00100000:3.0:1787833843.226185:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+62:11508:x1874679367283840:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787833843.226306:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+62:11508:x1874679367283840:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 122us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833843.226314:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 180 00000100:00100000:3.0:1787833843.240797:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833843.240937:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367283968 00000100:00100000:0.0:1787833843.240948:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367283968 00000100:00100000:0.0:1787833843.241008:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 181 00000100:00100000:0.0:1787833843.241019:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+62:11508:x1874679367283968:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833843.241039:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833843.241059:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e77592b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d3d expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.241148:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.241163:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.241175:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833843.241223:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833843.241241:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.241269:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e77592b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d3d expref: 64 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.241287:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d3d expref: 63 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.241296:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:0.0:1787833843.241312:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787833843.241316:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751fe00, rc 0) 00000100:00100000:0.0:1787833843.241404:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+63:11508:x1874679367283968:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 387us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833843.241412:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 181 00000100:00100000:3.0:1787833843.249552:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833843.249646:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367284096 00000100:00100000:2.0:1787833843.249657:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367284096 00000100:00100000:2.0:1787833843.249723:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:2.0:1787833843.249733:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367284096:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833843.249761:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833843.249784:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d44 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833843.249823:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902df3, blocks: 0x1 00010000:00010000:2.0:1787833843.249844:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1787833843.249849:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833843.249859:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d44 expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.249880:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d44 expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.249894:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3200, rc 0) 00000100:00100000:2.0:1787833843.249947:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367284096:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 216us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833843.249955:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:3.0:1787833843.252398:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833843.252490:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367284352 00000100:00100000:2.0:1787833843.252500:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367284352 00000100:00100000:2.0:1787833843.252560:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:2.0:1787833843.252570:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+63:11508:x1874679367284352:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787833843.252680:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+63:11508:x1874679367284352:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 111us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833843.252688:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:3.0:1787833843.255439:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833843.255531:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367284480 00000100:00100000:2.0:1787833843.255540:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367284480 00000100:00100000:2.0:1787833843.255596:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:2.0:1787833843.255606:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+8:11508:x1874679367284480:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833843.255638:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833843.255657:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d4b expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.255705:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d44 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.255715:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833843.255720:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833843.255726:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.255772:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d44 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.255787:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d44 expref: 9 pid: 6659 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833843.255802:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1874679375668352:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833843.255888:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647424f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833843.257658:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1874679375668352:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833843.257696:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 9 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.257714:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2c00, rc 0) 00000100:00100000:2.0:1787833843.257795:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+9:11508:x1874679367284480:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2190us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833843.257804:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:3.0:1787833843.262897:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833843.262988:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367284608 00000100:00100000:2.0:1787833843.262998:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367284608 00010000:00010000:2.0:1787833843.263041:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d44 expref: 9 pid: 6659 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833843.263082:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:2.0:1787833843.263092:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2345:x1874679367284608:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833843.263107:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833843.263130:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d44 expref: 9 pid: 6659 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.263144:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d44 expref: 9 pid: 6659 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.263167:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e775939 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d44 expref: 9 pid: 6659 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.263181:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833843.263185:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833843.263194:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.263204:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.263263:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833843.263285:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca4f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5802:1874679375668480:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787833843.263393:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647424f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833843.267126:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64778dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375668608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833843.267206:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833843.267515:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375668608 00000100:00100000:1.0:1787833843.267524:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375668608 00000100:00080000:2.0:1787833843.267578:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833843.267598:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787833843.267608:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375668608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833843.267644:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833843.267692:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375668608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833843.267700:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787833843.267732:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64778dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375668608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833843.272377:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca4f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5802:1874679375668480:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787833843.272417:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833843.272483:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367284608:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 9392us (9595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833843.272495:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:3.0:1787833843.275227:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833843.275269:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367284736 00000100:00100000:3.0:1787833843.275277:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367284736 00002000:00100000:3.0:1787833843.275366:0:6665:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b647745d680 x1874679367284736/t0(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:649/0 lens 504/0 e 0 to 0 dl 1787833854 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833843.275378:0:6665:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b647745d680 with x1874679367284736 ext(0->8) 00002000:00010000:3.0:1787833843.275384:0:6665:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b647745d680 00000100:00100000:3.0:1787833843.275414:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787833843.275426:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367284736:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787833843.275947:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:320cb14b-678a-483a-8914-ee446104f369+10:2344:x1874679367284736:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 520us (728us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787833843.275957:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00002000:00100000:3.0:1787833843.275964:0:6665:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b647745d680 x1874679367284736/t4294967314(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:649/0 lens 504/448 e 0 to 0 dl 1787833854 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833843.275972:0:6665:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b647745d680 with x1874679367284736 ext(0->8) 00002000:00010000:3.0:1787833843.275976:0:6665:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b647745d680 00000100:00100000:3.0:1787833843.280465:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833843.280583:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367284864 00000100:00100000:1.0:1787833843.280594:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367284864 00000100:00100000:1.0:1787833843.280648:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 183 00000100:00100000:1.0:1787833843.280658:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+63:11508:x1874679367284864:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787833843.379940:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+63:11508:x1874679367284864:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 99271us (99476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833843.379956:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 183 00000001:00080000:0.0:1787833843.379998:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1787833843.380004:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:0.0:1787833843.380077:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787833843.380094:0:5838:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6444c6d300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787833843.380098:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b645097e800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6444c6d900 00000020:00080000:0.0:1787833843.380101:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b645097eb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6450793800 00000001:00080000:0.0:1787833843.380125:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1787833843.380307:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787833843.380514:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787833843.380533:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6341fa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375668736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787833843.380594:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833843.380654:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833843.380661:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6341fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375668864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787833843.380683:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833843.380722:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375668736 00000100:00100000:0.0:1787833843.380729:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375668736 00000100:00100000:0.0:1787833843.380941:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375668864 00000100:00100000:0.0:1787833843.380945:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375668864 00000100:00100000:1.0:1787833843.385001:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787833843.385022:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375668736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787833843.385212:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787833843.385216:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787833843 00002000:00010000:1.0:1787833843.385218:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787833843.385220:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787833843 -> 1787833843 00002000:00010000:1.0:1787833843.385223:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787833843.385307:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1874679375668736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 293us (4712us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787833843.385314:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787833843.385372:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787833843.385379:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375668864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787833843.385395:0:6661:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1787833843.385421:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a902df0, atime: 0x6a902df0, ctime: 0x6a902df0, blocks: 0xb 00010000:00010000:1.0:1787833843.385428:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.385444:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1787833843.385449:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833843.385456:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.385473:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.385484:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.385491:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.385510:0:6661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787833843.385977:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1874679375668864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 597us (5291us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787833843.385984:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:1.0:1787833843.386010:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833843.386017:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.386032:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833843.386036:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.386045:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.386061:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.386068:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775947 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.386086:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833843.386087:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833843.386089:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833843.386385:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787833843.386391:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787833843.386414:0:3280:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b6341fa9a40 x1874679375668864/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787833859 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787833843.386425:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6341fa9a40/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787833843.386430:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6341fa9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375668864:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1787833843.386444:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6341fa8780/2, rc 0, transno 4294967315 00000100:00100000:2.0:1787833843.386449:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6341fa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375668736:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787833843.387425:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833843.388017:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833843.388260:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367284992 00000100:00100000:1.0:1787833843.388268:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367284992 00000100:00100000:2.0:1787833843.390854:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:2.0:1787833843.390888:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+10:2345:x1874679367284992:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787833843.423185:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1787833843.423210:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1787833843.423217:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1787833843.423439:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367284992:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 32551us (35422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833843.423451:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:3.0:1787833843.427123:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833843.428698:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367285248 00000100:00100000:2.0:1787833843.428715:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367285248 00000100:00100000:2.0:1787833843.428788:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 184 00000100:00100000:2.0:1787833843.428800:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+18:11508:x1874679367285248:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787833843.428856:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833843.428888:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e775932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d3d expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.428905:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:2.0:1787833843.428910:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833843.428941:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.428955:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.428964:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833843.429241:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2f62a13 reply state 0000000092f93dc1 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833843.429251:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833843.429576:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+19:11508:x1874679367285248:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 777us (2462us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787833843.429599:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 184 00010000:00010000:0.0:1787833843.439905:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.439923:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.439940:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.439948:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833843.439953:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.439961:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.439979:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:0.0:1787833843.439982:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833843.440003:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.440009:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3400/0x2bdb54ee5e77594e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.440854:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833843.440943:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367285376 00000100:00100000:2.0:1787833843.440953:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367285376 00000100:00100000:2.0:1787833843.441011:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:2.0:1787833843.441021:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367285376:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787833843.441280:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787833843.441284:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787833843 -> 1787833842 00002000:00010000:2.0:1787833843.441286:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787833840 00002000:00010000:2.0:1787833843.441287:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787833843 -> 1787833842 00002000:00010000:2.0:1787833843.441289:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787833843.441643:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367285376:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 622us (795us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787833843.441652:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:3.0:1787833843.447968:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833843.448068:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367285632 00000100:00100000:1.0:1787833843.448077:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367285632 00000100:00100000:1.0:1787833843.448132:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 185 00000100:00100000:1.0:1787833843.448141:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+18:11508:x1874679367285632:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787833843.448222:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.448239:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d2f expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.448249:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.448282:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d2f expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.448296:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d2f expref: 18 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833843.448310:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64778dcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375668992:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833843.448460:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647761e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833843.451726:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64778dcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1874679375668992:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833843.451767:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.453117:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833843.453524:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367285760 00000100:00100000:0.0:1787833843.453534:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367285760 00010000:00010000:0.0:1787833843.453579:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d2f expref: 19 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833843.453621:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787833843.453630:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446008450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+19:2344:x1874679367285760:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833843.453644:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833843.453651:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d2f expref: 19 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.453664:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d2f expref: 19 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.453686:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775916 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d2f expref: 19 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.453701:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:0.0:1787833843.453705:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.453715:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.453737:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.453778:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833843.453883:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446008450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+18:2344:x1874679367285760:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 253us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833843.453891:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00010000:00010000:1.0:1787833843.454084:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.454093:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.454123:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.454140:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.454146:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.454152:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833843.454156:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.454164:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.454172:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:1.0:1787833843.454175:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787833843.454178:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.454184:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198200/0x2bdb54ee5e775955 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833843.454226:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+17:11508:x1874679367285632:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 6085us (6268us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787833843.454234:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 185 00000100:00100000:3.0:1787833843.458010:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833843.458175:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367285888 00000100:00100000:2.0:1787833843.458185:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367285888 00000100:00100000:2.0:1787833843.458287:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:2.0:1787833843.458297:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367285888:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787833843.458516:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.458537:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.458546:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833843.458550:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833843.458569:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.458602:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.458616:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 8 pid: 6660 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833843.458630:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1874679375669120:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833843.458758:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6443d9eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787833843.461553:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1874679375669120:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833843.461583:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.463813:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833843.464003:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367286016 00000100:00100000:2.0:1787833843.464014:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367286016 00010000:00010000:2.0:1787833843.464060:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 9 pid: 6660 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833843.464097:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:2.0:1787833843.464108:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2345:x1874679367286016:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833843.464124:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833843.464149:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 9 pid: 6660 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.464183:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 9 pid: 6660 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.464210:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c70a8a2/0x2bdb54ee5e775940 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d4b expref: 9 pid: 6660 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.464226:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833843.464230:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833843.464236:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.464246:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.464289:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833843.464401:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367286016:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 294us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833843.464409:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00010000:00010000:3.0:1787833843.465259:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.465283:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.465433:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.465443:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.465451:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.465459:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833843.465464:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.465472:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.465501:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.465508:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77595c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.465588:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367285888:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 7288us (7585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833843.465598:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787833843.468809:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833843.468986:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367286272 00000100:00100000:0.0:1787833843.468997:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367286272 00000100:00100000:0.0:1787833843.469060:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 186 00000100:00100000:0.0:1787833843.469070:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+17:11508:x1874679367286272:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787833843.469151:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.469169:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.469180:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.469609:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.469622:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d36 expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.469631:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.469683:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d36 expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.469698:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d36 expref: 18 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833843.469712:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6341faa940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375669248:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833843.469847:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64431e7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787833843.473421:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833843.473499:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367286400 00000100:00100000:1.0:1787833843.473510:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367286400 00010000:00010000:1.0:1787833843.473550:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d36 expref: 19 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833843.473593:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:1.0:1787833843.473616:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+19:2345:x1874679367286400:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833843.473631:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833843.473637:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d36 expref: 19 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.473650:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d36 expref: 19 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.473671:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:1.0:1787833843.473675:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.473684:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.473691:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.473708:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833843.473775:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+19:2345:x1874679367286400:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 160us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833843.473782:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00010000:00010000:3.0:1787833843.474031:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775924 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d36 expref: 18 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.474046:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6341faa940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375669248:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833843.474065:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.474074:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.474079:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833843.474249:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787833843.474456:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787833843.474503:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787833843.474598:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1874679375669376:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787833843.474660:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833843.474908:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf240 going to sleep for 11 seconds 00000100:00100000:2.0:1787833843.476143:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375669376 00000100:00100000:2.0:1787833843.476155:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375669376 00000100:00100000:2.0:1787833843.476217:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833843.476226:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5816:x1874679375669376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787833843.476659:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5816:x1874679375669376:12345-0@lo:1000:mdt00_001.0 Request processed in 433us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833843.476668:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787833843.476768:0:5816:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787833843.476774:0:5816:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6341fa8780, transno 4294967315 00000100:00100000:3.0:1787833843.476785:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1874679375669376:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787833843.477260:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787833843.477405:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1874679375669504:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787833843.477448:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833843.477468:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833843.477583:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375669504 00000100:00100000:1.0:1787833843.477588:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375669504 00000100:00100000:1.0:1787833843.477630:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787833843.477638:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1874679375669504:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787833843.477826:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1874679375669504:12345-0@lo:1000:mdt00_001.0 Request processed in 188us (377us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787833843.477844:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787833843.478321:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1874679375669504:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787833843.478396:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478406:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478413:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478419:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.478424:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478432:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478448:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b646021da00) 00010000:00010000:3.0:1787833843.478451:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833843.478455:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478470:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e77596a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478501:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478507:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478513:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478519:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.478522:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478528:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478536:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3800) 00010000:00010000:3.0:1787833843.478538:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833843.478541:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478547:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e77589f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478570:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478583:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d1a expref: 21 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478597:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478624:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d1a expref: 21 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.478639:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d1a expref: 21 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.478652:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779dc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375669632:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833843.478716:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833843.483389:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833843.483525:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367286528 00000100:00100000:1.0:1787833843.483534:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367286528 00010000:00010000:1.0:1787833843.483572:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d1a expref: 22 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833843.483613:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:1.0:1787833843.483623:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+22:2344:x1874679367286528:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833843.483639:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833843.483645:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d1a expref: 22 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.483657:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d1a expref: 22 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.483679:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3800) 00010000:00010000:1.0:1787833843.483684:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.483693:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.483699:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833843.483717:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833843.483783:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+22:2344:x1874679367286528:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 161us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833843.483809:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00010000:00010000:3.0:1787833843.483958:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e7758bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d1a expref: 21 pid: 7195 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.483976:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779dc780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375669632:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833843.483997:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484005:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484010:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484023:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484029:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484042:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484048:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440030a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.484052:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484059:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484068:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3800) 00010000:00010000:3.0:1787833843.484070:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833843.484074:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484080:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775971 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484092:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484098:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484103:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484108:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fc00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833843.484110:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484125:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484132:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3800) 00010000:00010000:3.0:1787833843.484134:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787833843.484137:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833843.484143:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775963 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833843.484433:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+20:11508:x1874679367286272:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 15364us (15632us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787833843.484441:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 186 00000020:00080000:3.0:1787833843.484444:0:5816:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787833843.485311:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833843.485316:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833843.485837:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787833843.485845:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833843.489567:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833843.490166:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367286784 00000100:00100000:3.0:1787833843.490177:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367286784 00000100:00100000:2.0:1787833843.490529:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:2.0:1787833843.490540:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f11050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+20:11508:x1874679367286784:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787833843.491731:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787833843.491963:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787833843.492020:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.492037:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.492048:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.492056:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.492062:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.492069:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833843.492131:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787833843.492293:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f11050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+22:11508:x1874679367286784:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1750us (2732us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787833843.492311:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000020:00080000:2.0:1787833843.492317:0:5819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787833843.492601:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833843.492609:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.492616:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833843.492620:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.492628:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.492640:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6474279700) 00010000:00010000:0.0:1787833843.492644:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787833843.492648:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.492654:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3800/0x2bdb54ee5e775978 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833843.492684:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833843.492686:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833843.492687:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833844.032072:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787833844.971796:0:12541:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833844.971806:0:12541:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833844.971845:0:12541:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787833844.971851:0:12541:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787833845.056072:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833845.136798:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833845.137058:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367287040 00000100:00100000:1.0:1787833845.137069:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367287040 00000100:00100000:1.0:1787833845.138073:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 187 00000100:00100000:1.0:1787833845.138083:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+22:11525:x1874679367287040:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833845.138106:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833845.138123:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e77597f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d52 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.138401:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775986 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.138415:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.138427:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833845.138439:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787833845.138582:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e77597f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d52 expref: 25 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.138604:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d52 expref: 24 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.138611:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833845.138613:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833845.138616:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198c00, rc 0) 00000100:00100000:1.0:1787833845.138675:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+24:11525:x1874679367287040:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 594us (1891us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787833845.138680:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 187 00000100:00080000:2.0:1787833845.141504:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833845.146203:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.146279:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367287168 00000100:00100000:2.0:1787833845.146289:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367287168 00000100:00100000:2.0:1787833845.146389:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 188 00000100:00100000:2.0:1787833845.146401:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+24:11525:x1874679367287168:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787833845.146480:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.146499:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.146510:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.146524:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.146531:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.146550:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.146838:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.146846:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.146853:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833845.146907:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.146919:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147008:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147014:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147020:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833845.147024:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147033:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147047:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:2.0:1787833845.147050:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833845.147055:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147061:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775994 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147074:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147079:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147090:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147095:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833845.147098:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147103:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147111:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6474279800) 00010000:00010000:2.0:1787833845.147114:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833845.147117:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147123:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e77599b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147137:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147143:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147149:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147154:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833845.147156:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147173:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147181:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6474279900) 00010000:00010000:2.0:1787833845.147183:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833845.147185:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.147191:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.147280:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+24:11525:x1874679367287168:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 879us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833845.147288:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 188 00000100:00100000:3.0:1787833845.208082:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.208125:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367287424 00000100:00100000:3.0:1787833845.208136:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367287424 00000100:00100000:3.0:1787833845.208189:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 189 00000100:00100000:3.0:1787833845.208198:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+24:11528:x1874679367287424:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833845.208217:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833845.208237:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7759a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d59 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.208359:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.208399:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.208411:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.208428:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.208435:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.208443:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.208825:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.208835:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.208844:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833845.208853:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787833845.209509:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209521:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209528:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209544:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.209548:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209557:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209571:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:3.0:1787833845.209574:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833845.209579:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209586:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e7759b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209600:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209607:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209613:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209619:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031e00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.209622:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209628:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209647:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b645a7d3800) 00010000:00010000:3.0:1787833845.209650:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833845.209654:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209660:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e7759b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209705:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e7759a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d59 expref: 27 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209788:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d59 expref: 26 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.209797:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833845.209799:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833845.209802:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c600, rc 0) 00000100:00100000:3.0:1787833845.209874:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+26:11528:x1874679367287424:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1677us (1805us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787833845.209884:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 189 00000100:00100000:1.0:1787833845.214105:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.214584:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367287552 00000100:00100000:2.0:1787833845.214595:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367287552 00000100:00100000:2.0:1787833845.214648:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 190 00000100:00100000:2.0:1787833845.214657:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+26:11528:x1874679367287552:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787833845.214739:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.214756:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.214768:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.214795:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.214816:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.214823:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.214828:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833845.214832:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.214840:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.214853:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833845.214856:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833845.214861:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.214868:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e7759cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.214945:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+26:11528:x1874679367287552:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 289us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833845.214952:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 190 00000100:00100000:2.0:1787833845.217727:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833845.217850:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367287808 00000100:00100000:0.0:1787833845.217861:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367287808 00000100:00100000:0.0:1787833845.217997:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:0.0:1787833845.218011:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+26:11528:x1874679367287808:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787833845.218245:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+27:11528:x1874679367287808:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 237us (531us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787833845.218260:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:2.0:1787833845.251760:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.251844:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367288064 00000100:00100000:3.0:1787833845.251855:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367288064 00000100:00100000:3.0:1787833845.251909:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 191 00000100:00100000:3.0:1787833845.251918:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+27:11054:x1874679367288064:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787833845.251964:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833845.251990:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7759d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d60 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.252130:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.252144:0:7195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d59 expref: 28 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.252152:0:7195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.252186:0:7195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d59 expref: 28 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.252199:0:7195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d59 expref: 28 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833845.252213:0:7195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779dcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375669760:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833845.252484:0:7195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833845.260491:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.260711:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367288192 00000100:00100000:2.0:1787833845.260731:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367288192 00010000:00010000:2.0:1787833845.260775:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d59 expref: 29 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.260838:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:2.0:1787833845.260848:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+29:2345:x1874679367288192:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833845.260864:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833845.260872:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d59 expref: 29 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.260882:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d59 expref: 29 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.260902:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833845.260906:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.260913:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.260918:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.261092:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833845.261141:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+29:2345:x1874679367288192:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 295us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833845.261149:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00010000:00010000:1.0:1787833845.261242:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e7759be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d59 expref: 28 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833845.261259:0:7195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779dcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375669760:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833845.261279:0:7195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.261293:0:7195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.261299:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833845.261318:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787833845.261528:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e7759d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d60 expref: 29 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.261558:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d60 expref: 28 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.261567:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833845.261570:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833845.261572:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2d600, rc 0) 00000100:00100000:1.0:1787833845.261607:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+28:11054:x1874679367288064:12345-192.168.202.15@tcp:101:bash.0 Request processed in 9690us (9860us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787833845.261612:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 191 00000100:00100000:3.0:1787833845.266833:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.266908:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367288448 00000100:00100000:2.0:1787833845.266917:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367288448 00000100:00100000:2.0:1787833845.267164:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 192 00000100:00100000:2.0:1787833845.267173:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+28:11054:x1874679367288448:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:2.0:1787833845.268106:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.268133:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.268146:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833845.268207:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787833845.268233:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000544036f7 reply state 00000000ee7cac96 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.268242:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787833845.268302:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787833845.268471:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+32:11054:x1874679367288448:12345-192.168.202.15@tcp:36:bash.0 Request processed in 1296us (1645us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787833845.268480:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 192 00000020:00080000:2.0:1787833845.268486:0:5815:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787833845.273047:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:1.0:1787833845.273127:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.273140:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.273148:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.273155:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833845.273160:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.273170:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.273188:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833845.273191:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833845.273196:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.273218:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e7759e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833845.273371:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367288576 00000100:00100000:0.0:1787833845.273380:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367288576 00000100:00100000:0.0:1787833845.273441:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 193 00000100:00100000:0.0:1787833845.273452:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+31:11054:x1874679367288576:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787833845.273475:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833845.273492:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7759ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d67 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.273547:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7759ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d67 expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.273561:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7759ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d67 expref: 32 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.273579:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:0.0:1787833845.273582:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833845.273590:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751ee00, rc 0) 00000100:00100000:0.0:1787833845.273649:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+32:11054:x1874679367288576:12345-192.168.202.15@tcp:101:bash.0 Request processed in 199us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833845.273656:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 193 00000100:00100000:0.0:1787833845.277874:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.278211:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367288704 00000100:00100000:2.0:1787833845.278220:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367288704 00000100:00100000:2.0:1787833845.278366:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:2.0:1787833845.278377:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+7:11054:x1874679367288704:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787833845.278401:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833845.278422:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d6e expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833845.278448:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a902df2, atime: 0x6a902df0, ctime: 0x6a902df2, blocks: 0xb 00010000:00010000:2.0:1787833845.278471:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=324s v=(0 0) 00010000:00010000:2.0:1787833845.278488:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833845.278497:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d6e expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.278515:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d6e expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.278528:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2000, rc 0) 00000100:00100000:2.0:1787833845.278581:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+8:11054:x1874679367288704:12345-192.168.202.15@tcp:101:bash.0 Request processed in 207us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833845.278588:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00080000:0.0:1787833845.279225:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833845.281253:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833845.284504:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367288832 00000100:00100000:0.0:1787833845.284520:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367288832 00002000:00010000:0.0:1787833845.284574:0:6664:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787833845.284578:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b64779dc3c0 with x1874679367288832 ext(0->18446744073709551615) 00002000:00010000:0.0:1787833845.284591:0:6664:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b64779dc3c0. 00000100:00100000:0.0:1787833845.284635:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787833845.284644:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367288832:12345-192.168.202.15@tcp:10:bash.0 00002000:00010000:0.0:1787833845.284959:0:6664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787833845.284973:0:6664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787833842 -> 1787833845 00002000:00010000:0.0:1787833845.284975:0:6664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787833840 -> 1787833840 00002000:00010000:0.0:1787833845.284978:0:6664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787833842 -> 1787833845 00002000:00010000:0.0:1787833845.284980:0:6664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787833845.285067:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+9:2345:x1874679367288832:12345-192.168.202.15@tcp:10:bash.0 Request processed in 424us (3821us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787833845.285076:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00002000:00010000:0.0:1787833845.285079:0:6664:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787833845.285082:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b64779dc3c0 with x1874679367288832 ext(0->18446744073709551615) 00002000:00010000:0.0:1787833845.285086:0:6664:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b64779dc3c0. 00000100:00100000:1.0:1787833845.363955:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.364181:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367288960 00000100:00100000:2.0:1787833845.364190:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367288960 00000100:00100000:2.0:1787833845.364246:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 194 00000100:00100000:2.0:1787833845.364255:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+32:11542:x1874679367288960:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787833845.364338:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364398:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364550:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364568:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364575:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364600:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364843:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364852:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364860:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787833845.364895:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364906:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364912:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364919:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364925:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833845.364929:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364937:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.364949:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:2.0:1787833845.364958:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833845.365146:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365154:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3000/0x2bdb54ee5e7759fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365166:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365172:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365178:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365183:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833845.365186:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365192:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365199:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6474279b00) 00010000:00010000:2.0:1787833845.365201:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833845.365204:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365209:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3c00/0x2bdb54ee5e775a04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365222:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365233:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365239:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365244:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833845.365247:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365252:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365259:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833845.365261:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833845.365263:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.365274:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.365949:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+32:11542:x1874679367288960:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1688us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833845.365960:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 194 00000100:00100000:2.0:1787833845.412068:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833845.412172:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367289216 00000100:00100000:0.0:1787833845.412182:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367289216 00000100:00100000:0.0:1787833845.412242:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 195 00000100:00100000:0.0:1787833845.412278:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+32:11545:x1874679367289216:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833845.412494:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833845.412519:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775a12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d75 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.412609:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.412625:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.412637:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.412652:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.412660:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.412667:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413199:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775a27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413211:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413220:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775a27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833845.413230:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787833845.413481:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413490:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413498:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413505:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833845.413509:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413517:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413531:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833845.413541:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833845.413546:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413554:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413567:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413574:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413580:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413586:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833845.413590:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413597:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413604:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b646021df00) 00010000:00010000:1.0:1787833845.413607:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833845.413609:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413614:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413660:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775a12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d75 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413687:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775a27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d75 expref: 34 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.413696:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833845.413699:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787833845.413702:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199a00, rc 0) 00000100:00100000:1.0:1787833845.413847:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+34:11545:x1874679367289216:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1579us (1790us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787833845.413857:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 195 00000100:00100000:3.0:1787833845.416654:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.416994:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367289344 00000100:00100000:2.0:1787833845.417004:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367289344 00000100:00100000:2.0:1787833845.417066:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 196 00000100:00100000:2.0:1787833845.417076:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+34:11545:x1874679367289344:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787833845.417160:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.417177:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d60 expref: 34 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.417186:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.417215:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d60 expref: 34 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.417229:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d60 expref: 34 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.417242:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375669888:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833845.417534:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833845.421096:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833845.421166:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367289600 00000100:00100000:0.0:1787833845.421175:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367289600 00000100:00100000:0.0:1787833845.421233:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:0.0:1787833845.421243:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+35:5586:x1874679367289600:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787833845.421616:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+36:5586:x1874679367289600:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 374us (528us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787833845.421625:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:3.0:1787833845.422670:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375669888:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833845.422697:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833845.424646:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833845.424736:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367289728 00000100:00100000:1.0:1787833845.424744:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367289728 00010000:00010000:1.0:1787833845.424787:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d60 expref: 36 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833845.424829:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:1.0:1787833845.424839:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+36:2345:x1874679367289728:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833845.424854:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833845.424861:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d60 expref: 36 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.424874:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d60 expref: 36 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.424897:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e7759da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d60 expref: 36 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.424937:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833845.424943:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.424951:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.424958:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.424992:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833845.425044:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+35:2345:x1874679367289728:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 207us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833845.425052:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 74 00010000:00010000:0.0:1787833845.425488:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.425497:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.425530:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.425537:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.425543:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.425549:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833845.425553:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.425560:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.425569:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:0.0:1787833845.425572:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787833845.425575:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.425581:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775a35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833845.425638:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+34:11545:x1874679367289344:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 8563us (8992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833845.425656:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 196 00000100:00100000:0.0:1787833845.428009:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.428280:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367289984 00000100:00100000:3.0:1787833845.428310:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367289984 00000100:00100000:3.0:1787833845.428400:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:3.0:1787833845.428409:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+34:11545:x1874679367289984:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787833845.428638:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+35:11545:x1874679367289984:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 228us (640us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787833845.428646:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:1.0:1787833845.503627:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.503729:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367290240 00000100:00100000:3.0:1787833845.503739:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367290240 00000100:00100000:3.0:1787833845.503799:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 197 00000100:00100000:3.0:1787833845.503809:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+35:11556:x1874679367290240:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:3.0:1787833845.503832:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833845.503856:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d7c expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.503934:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.503948:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.503960:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.503975:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.503982:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.503988:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504403:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504413:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504420:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833845.504430:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787833845.504523:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504531:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504538:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504544:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.504549:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504556:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504569:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:3.0:1787833845.504572:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833845.504576:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504593:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504607:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504612:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504617:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504622:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.504625:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504633:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504641:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b645a7d3800) 00010000:00010000:3.0:1787833845.504643:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833845.504646:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504652:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504695:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d7c expref: 38 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504708:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d7c expref: 37 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.504721:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833845.504724:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833845.504727:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2ca00, rc 0) 00000100:00100000:3.0:1787833845.504790:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+37:11556:x1874679367290240:12345-192.168.202.15@tcp:101:cat.0 Request processed in 981us (1173us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787833845.504799:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 197 00000100:00100000:0.0:1787833845.510413:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.510498:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367290496 00000100:00100000:3.0:1787833845.510509:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367290496 00000100:00100000:3.0:1787833845.510569:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:3.0:1787833845.510580:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+37:11556:x1874679367290496:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:3.0:1787833845.510825:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+38:11556:x1874679367290496:12345-192.168.202.15@tcp:35:cat.0 Request processed in 246us (422us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787833845.510833:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:0.0:1787833845.527028:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.527547:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367290752 00000100:00100000:3.0:1787833845.527557:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367290752 00000100:00100000:3.0:1787833845.527619:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 198 00000100:00100000:3.0:1787833845.527629:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+38:11557:x1874679367290752:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:3.0:1787833845.527686:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787833845.527735:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d7c expref: 38 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.527759:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775a27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d75 expref: 37 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.527772:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7759ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d67 expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.527795:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833845.527807:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833845.527826:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.527839:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.527849:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.527862:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.527869:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.527876:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.528569:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.528579:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.528586:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833845.529198:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1787833845.529208:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324284867180ns, next at 325284864905ns, rc = 0 00010000:00010000:3.0:1787833845.529568:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529581:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529590:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529598:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529604:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529610:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529677:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833845.529699:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529705:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529712:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529726:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.529731:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529738:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529756:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3100) 00010000:00010000:3.0:1787833845.529759:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787833845.529763:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529770:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a6d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529790:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529796:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529802:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529807:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.529810:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529815:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529822:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:3.0:1787833845.529825:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833845.529828:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.529833:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833845.529855:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da887a13 reply state 000000005614b3f2 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833845.529863:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833845.530013:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+37:11557:x1874679367290752:12345-192.168.202.15@tcp:36:rm.0 Request processed in 2382us (2993us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787833845.530023:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 198 00010000:00010000:0.0:1787833845.530599:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833845.530607:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.530614:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833845.530618:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.530624:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.530635:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b645a7d3100) 00010000:00010000:0.0:1787833845.530637:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787833845.530640:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.530646:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775a74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.530661:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833845.530663:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833845.530664:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833845.535212:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.535229:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.535252:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.535259:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833845.535264:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.535288:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.535306:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b645a7d3800) 00010000:00010000:0.0:1787833845.535309:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833845.535314:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.535329:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833845.590760:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.590846:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367291008 00000100:00100000:3.0:1787833845.590856:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367291008 00000100:00100000:3.0:1787833845.590914:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 199 00000100:00100000:3.0:1787833845.590924:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+36:11563:x1874679367291008:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787833845.590950:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833845.590971:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d83 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591140:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591157:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591170:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591187:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591194:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591212:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833845.591792:0:7195:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787833845.591936:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591946:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591954:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591988:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.591995:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.592002:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.592008:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.592011:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.592019:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.592030:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:3.0:1787833845.592033:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833845.592045:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.592053:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775a82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787833845.592067:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004841a2fc reply state 00000000d077f8a7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833845.592075:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787833845.592101:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775a7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d83 expref: 39 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.592114:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d83 expref: 38 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.592121:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833845.592124:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833845.592126:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2d600, rc 0) 00000100:00100000:3.0:1787833845.592202:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+39:11563:x1874679367291008:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1279us (1453us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787833845.592210:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 199 00010000:00010000:3.0:1787833845.596309:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.596361:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.596370:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.596394:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.596399:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.596406:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.596423:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833845.596426:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833845.596430:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.596436:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775a89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833845.597606:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833845.597662:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367291136 00000100:00100000:1.0:1787833845.597671:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367291136 00000100:00100000:1.0:1787833845.597823:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:1.0:1787833845.597834:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2345:x1874679367291136:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787833845.597853:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833845.597873:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d8a expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787833845.597897:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1787833845.597900:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833845.597937:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1787833845.597942:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833845.597951:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d8a expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.597985:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d8a expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.597998:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198200, rc 0) 00000100:00100000:1.0:1787833845.598059:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367291136:12345-192.168.202.15@tcp:101:bash.0 Request processed in 227us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833845.598066:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:1.0:1787833845.601773:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.602008:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367291264 00000100:00100000:2.0:1787833845.602020:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367291264 00000100:00100000:2.0:1787833845.602114:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:2.0:1787833845.602125:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+6:11563:x1874679367291264:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787833845.602144:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833845.602164:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d91 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.602197:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d8a expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.602226:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833845.602230:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833845.602236:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.602270:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d8a expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.602295:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d8a expref: 7 pid: 6661 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.602310:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1874679375670016:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833845.602447:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833845.605554:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1874679375670016:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833845.605595:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.605617:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3c00, rc 0) 00000100:00100000:2.0:1787833845.605675:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:320cb14b-678a-483a-8914-ee446104f369+7:11563:x1874679367291264:12345-192.168.202.15@tcp:101:bash.0 Request processed in 3553us (3912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833845.605685:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:0.0:1787833845.607519:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.607713:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367291392 00000100:00100000:2.0:1787833845.607728:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367291392 00010000:00010000:2.0:1787833845.607767:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d8a expref: 7 pid: 6661 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.607825:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:2.0:1787833845.607835:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367291392:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833845.607851:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833845.607874:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d8a expref: 7 pid: 6661 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.607887:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d8a expref: 7 pid: 6661 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.607911:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ca95a34/0x2bdb54ee5e775a9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d8a expref: 7 pid: 6661 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.607928:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833845.607933:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833845.607940:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.607951:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.607987:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.608000:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1874679375670144:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787833845.608089:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772eac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833845.612471:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.612644:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1874679375670144:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787833845.612667:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833845.612734:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+6:2345:x1874679367291392:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 4900us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833845.612746:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:3.0:1787833845.612924:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367291648 00000100:00100000:3.0:1787833845.612932:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367291648 00000100:00100000:3.0:1787833845.612983:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:3.0:1787833845.612992:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+38:11563:x1874679367291648:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:3.0:1787833845.613315:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+39:11563:x1874679367291648:12345-192.168.202.15@tcp:35:bash.0 Request processed in 324us (853us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787833845.613332:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:0.0:1787833845.742385:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.742516:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367291776 00000100:00100000:3.0:1787833845.742527:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367291776 00000100:00100000:3.0:1787833845.742596:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 200 00000100:00100000:3.0:1787833845.742607:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+39:11579:x1874679367291776:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833845.742634:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833845.742670:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775aac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d98 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.742746:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.742759:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.742770:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833845.742827:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787833845.742830:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833845.742852:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.742876:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2ca00/0x2bdb54ee5e775aac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d98 expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.742893:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d98 expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.742900:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:3.0:1787833845.742902:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833845.742906:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c000, rc 0) 00000100:00100000:3.0:1787833845.742967:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+40:11579:x1874679367291776:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 362us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833845.742974:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 200 00000100:00100000:0.0:1787833845.746591:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833845.746804:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367292032 00000100:00100000:1.0:1787833845.746814:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367292032 00000100:00100000:1.0:1787833845.746910:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 201 00000100:00100000:1.0:1787833845.746918:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477435a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+40:11579:x1874679367292032:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833845.746939:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833845.746961:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775aba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3d9f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.747065:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.747078:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.747089:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833845.747099:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787833845.747225:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775aba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d9f expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.747239:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d9f expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.747245:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:1.0:1787833845.747248:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833845.747251:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198800, rc 0) 00000100:00100000:1.0:1787833845.747331:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477435a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+42:11579:x1874679367292032:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 413us (750us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787833845.747363:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 201 00000100:00100000:3.0:1787833845.750854:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.750901:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.750926:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367292416 00000100:00100000:3.0:1787833845.750935:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367292416 00000100:00100000:3.0:1787833845.750985:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 202 00000100:00100000:3.0:1787833845.750994:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+42:11579:x1874679367292416:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833845.751019:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833845.751037:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775acf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3da6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.751127:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775ad6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.751138:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.751145:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775ad6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833845.751153:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787833845.751243:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775acf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3da6 expref: 45 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.751260:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3da6 expref: 44 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.751269:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833845.751273:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787833845.751276:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c600, rc 0) 00000100:00100000:3.0:1787833845.751457:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+44:11579:x1874679367292416:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 464us (554us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787833845.751469:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 202 00000100:00100000:0.0:1787833845.752013:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367292160 00000100:00100000:0.0:1787833845.752019:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367292160 00000100:00100000:0.0:1787833845.752063:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787833845.752071:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446998c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+44:2345:x1874679367292160:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833845.752081:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833845.752102:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198800/0x2bdb54ee5e775ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d9f expref: 44 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.752111:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:0.0:1787833845.752113:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833845.752130:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446998c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+43:2345:x1874679367292160:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 62us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833845.752134:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787833845.766800:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.767090:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367292544 00000100:00100000:2.0:1787833845.767101:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367292544 00000100:00100000:2.0:1787833845.767167:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:2.0:1787833845.767176:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+6:2344:x1874679367292544:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:2.0:1787833845.767223:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.767244:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.767252:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833845.767257:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833845.767261:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.767313:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.767372:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 6 pid: 6660 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.767412:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1874679375670272:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833845.767496:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833845.772082:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833845.772748:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367292672 00000100:00100000:0.0:1787833845.772757:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367292672 00002000:00100000:0.0:1787833845.772813:0:6666:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b646dca4000 x1874679367292672/t0(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:651/0 lens 504/0 e 0 to 0 dl 1787833856 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833845.772824:0:6666:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b646dca4000 with x1874679367292672 ext(0->8) 00010000:00010000:0.0:1787833845.772833:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 7 pid: 6660 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.772851:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 7 pid: 6660 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833845.772860:0:6666:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b646dca4000 00000100:00100000:0.0:1787833845.772896:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:0.0:1787833845.772906:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367292672:12345-192.168.202.15@tcp:4:lfs.0 00000100:00100000:0.0:1787833845.773431:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:320cb14b-678a-483a-8914-ee446104f369+9:2344:x1874679367292672:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 525us (1357us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787833845.773440:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00002000:00100000:0.0:1787833845.773447:0:6666:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b646dca4000 x1874679367292672/t4294967308(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:651/0 lens 504/448 e 0 to 0 dl 1787833856 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787833845.773462:0:6666:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b646dca4000 with x1874679367292672 ext(0->8) 00010000:00010000:0.0:1787833845.773469:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 9 pid: 6660 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.773482:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 9 pid: 6660 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787833845.773489:0:6666:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b646dca4000 00000100:00100000:3.0:1787833845.777939:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1874679375670272:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833845.777971:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833845.778123:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.779901:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367292800 00000100:00100000:2.0:1787833845.779916:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367292800 00010000:00010000:2.0:1787833845.779981:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 9 pid: 6660 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.780029:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:2.0:1787833845.780038:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2347:x1874679367292800:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833845.780056:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787833845.780076:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787833845.780078:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787833845 00002000:00010000:2.0:1787833845.780080:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787833845 00002000:00010000:2.0:1787833845.780081:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787833845 00010000:00010000:2.0:1787833845.780086:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 9 pid: 6660 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.780096:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 9 pid: 6660 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.780115:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775aa5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d91 expref: 9 pid: 6660 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.780143:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833845.780146:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833845.780150:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.780157:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.780189:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833845.780223:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.780232:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.780257:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833845.780457:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+8:2347:x1874679367292800:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 418us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833845.780465:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00010000:00010000:3.0:1787833845.780617:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.780691:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.780698:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833845.780702:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.780800:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.780814:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.780822:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2c886f1/0x2bdb54ee5e775ae4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833845.780883:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2344:x1874679367292544:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 13707us (14092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833845.780891:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:1.0:1787833845.784908:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.785050:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367293056 00000100:00100000:3.0:1787833845.785061:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367293056 00000100:00100000:3.0:1787833845.785154:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:3.0:1787833845.785165:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f10450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+43:11579:x1874679367293056:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:3.0:1787833845.785233:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775ad6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3da6 expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833845.785647:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787833845.785698:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787833845.786078:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787833845.786131:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.786145:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d83 expref: 47 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.786166:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.786201:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d83 expref: 47 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.786215:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d83 expref: 47 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833845.786229:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779de1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874679375670400:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833845.786312:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833845.791808:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779de1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1874679375670400:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833845.791843:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833845.797979:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.798253:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367293184 00000100:00100000:3.0:1787833845.798264:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367293184 00010000:00010000:3.0:1787833845.798310:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d83 expref: 48 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833845.798428:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:3.0:1787833845.798439:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+48:2345:x1874679367293184:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833845.798454:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833845.798462:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d83 expref: 48 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.798496:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d83 expref: 48 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.798530:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775a90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d83 expref: 48 pid: 7195 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.798547:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833845.798552:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.798560:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.798567:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.798595:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833845.798663:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+47:2345:x1874679367293184:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 227us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833845.798671:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00010000:00010000:0.0:1787833845.799327:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833845.800945:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833845.801191:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787833845.801611:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787833845.801874:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6341fa8780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874679375670528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833845.802075:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833845.802122:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6443d9e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833845.802191:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375670528 00000100:00100000:3.0:1787833845.802199:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375670528 00000100:00100000:3.0:1787833845.802273:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787833845.802282:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1874679375670528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787833845.802415:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1874679375670528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 133us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833845.802423:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787833845.802477:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6341fa8780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874679375670528:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1787833845.802819:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787833845.803302:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787833845.803470:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779de1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874679375670656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787833845.803595:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833845.803671:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf840 going to sleep for 11 seconds 00000100:00100000:0.0:1787833845.804102:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375670656 00000100:00100000:0.0:1787833845.804109:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375670656 00000100:00100000:0.0:1787833845.804144:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787833845.804152:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1874679375670656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787833845.804368:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5818:x1874679375670656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 216us (772us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787833845.804385:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787833845.804586:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779de1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1874679375670656:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787833845.804809:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787833845.804856:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.804866:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.804873:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.804879:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440030a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.804883:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.804891:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.804907:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833845.804910:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787833845.805052:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.805062:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775aeb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787833845.805260:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787833845.806103:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787833845.806118:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324561777004ns, next at 325561774101ns, rc = 0 00000001:00080000:3.0:1787833845.806127:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787833845.806180:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3e00) 00010000:00010000:3.0:1787833845.806184:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787833845.806192:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775ad6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3da6 expref: 51 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833845.806464:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f10450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+50:11579:x1874679367293056:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 21299us (21564us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787833845.806475:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000020:00080000:3.0:1787833845.806481:0:5818:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787833845.813526:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.813840:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367293312 00000100:00100000:3.0:1787833845.813851:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367293312 00000100:00100000:3.0:1787833845.813926:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 203 00000100:00100000:3.0:1787833845.813938:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+50:11579:x1874679367293312:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833845.813961:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833845.813983:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775af2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3dad expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.814047:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775af2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dad expref: 51 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.814063:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775af2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dad expref: 51 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.814100:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833845.814104:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833845.814108:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031e00, rc 0) 00000100:00100000:3.0:1787833845.814170:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+51:11579:x1874679367293312:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 235us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833845.814177:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 203 00000100:00100000:0.0:1787833845.817913:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.818056:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367293568 00000100:00100000:2.0:1787833845.818068:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367293568 00000100:00100000:2.0:1787833845.818123:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:2.0:1787833845.818133:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+51:11579:x1874679367293568:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833845.818422:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+52:11579:x1874679367293568:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 290us (518us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787833845.818431:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:0.0:1787833845.825778:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375671168:0@lo:400:kworker.0 00000100:00100000:0.0:1787833845.825858:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833845.825908:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833845.825924:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1874679375671040:0@lo:400:kworker.0 00000100:00100000:0.0:1787833845.825952:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833845.827408:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375670784:0@lo:400:kworker.0 00000100:00100000:1.0:1787833845.827472:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833845.827534:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375671296:0@lo:400:kworker.0 00000100:00100000:1.0:1787833845.827562:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833845.827585:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833845.827591:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375670912:0@lo:400:kworker.0 00000100:00100000:1.0:1787833845.827611:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833845.827661:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375671040 00000100:00100000:1.0:1787833845.827668:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375671040 00000100:00080000:1.0:1787833845.827697:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833845.827745:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375671296 00000100:00100000:1.0:1787833845.827749:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375671296 00000100:00080000:1.0:1787833845.827761:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833845.827773:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375670912 00000100:00100000:1.0:1787833845.827776:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375670912 00000100:00100000:1.0:1787833845.827812:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787833845.827819:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874679375671040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833845.827875:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874679375671040:12345-0@lo:400:kworker.0 Request processed in 57us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833845.827882:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787833845.827899:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787833845.827904:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375671296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833845.828226:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375671296:12345-0@lo:400:kworker.0 Request processed in 321us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833845.828233:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787833845.828271:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375671296:0@lo:400:kworker.0 00000100:00100000:1.0:1787833845.828311:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787833845.828331:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375670912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833845.828401:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375670912:12345-0@lo:400:kworker.0 Request processed in 84us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833845.828407:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787833845.828430:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375670912:0@lo:400:kworker.0 00000100:00100000:3.0:1787833845.828661:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375671168 00000100:00100000:3.0:1787833845.828666:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375671168 00000100:00100000:3.0:1787833845.828699:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787833845.828705:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1874679375671168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833845.828755:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1874679375671168:12345-0@lo:400:kworker.0 Request processed in 50us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833845.828761:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1787833845.829153:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833845.829419:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375670784 00000100:00100000:0.0:1787833845.829425:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375670784 00000100:00100000:0.0:1787833845.829469:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787833845.829477:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375670784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833845.829544:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375670784:12345-0@lo:400:kworker.0 Request processed in 68us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833845.829551:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787833845.829599:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1874679375671040:0@lo:400:kworker.0 00000100:00100000:0.0:1787833845.829611:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375671168:0@lo:400:kworker.0 00000100:00100000:2.0:1787833845.829744:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375670784:0@lo:400:kworker.0 00000100:00100000:0.0:1787833845.923640:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833845.923711:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367293696 00000100:00100000:1.0:1787833845.923810:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367293696 00000100:00100000:1.0:1787833845.923932:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 204 00000100:00100000:1.0:1787833845.923944:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+52:11589:x1874679367293696:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:1.0:1787833845.924028:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924048:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924077:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924093:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924101:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924108:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924217:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924226:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924233:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787833845.924293:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924307:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924313:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924333:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924394:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833845.924399:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924407:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924420:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833845.924423:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833845.924428:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924435:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775af9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924451:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924456:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924462:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924467:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833845.924472:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924478:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924496:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6451e01b00) 00010000:00010000:1.0:1787833845.924498:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833845.924511:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924517:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199200/0x2bdb54ee5e775b00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924532:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924539:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924543:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924548:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833845.924550:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924555:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924561:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833845.924563:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833845.924566:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833845.924571:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833845.924675:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+52:11589:x1874679367293696:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 732us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833845.924684:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 204 00000100:00100000:0.0:1787833845.970144:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.970230:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367293952 00000100:00100000:3.0:1787833845.970240:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367293952 00000100:00100000:3.0:1787833845.970302:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 205 00000100:00100000:3.0:1787833845.970314:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+52:11592:x1874679367293952:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833845.970386:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833845.970486:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775b0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3db4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.970638:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.970661:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.970672:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.970688:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.970695:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.970700:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971121:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e775b23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971131:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e775b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971138:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e775b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833845.971148:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787833845.971261:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971278:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971286:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971299:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833845.971303:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971311:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971334:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:2.0:1787833845.971337:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833845.971369:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971376:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971389:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971396:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971401:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971405:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833845.971408:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971414:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971433:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6474279b00) 00010000:00010000:2.0:1787833845.971435:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833845.971438:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971444:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.971489:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775b0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3db4 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.972327:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e775b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3db4 expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833845.972456:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833845.972460:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833845.972463:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3600, rc 0) 00000100:00100000:2.0:1787833845.972551:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+54:11592:x1874679367293952:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 2240us (2416us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787833845.972560:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 205 00000100:00100000:0.0:1787833845.976213:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833845.976334:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367294080 00000100:00100000:3.0:1787833845.976412:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367294080 00000100:00100000:3.0:1787833845.976478:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:3.0:1787833845.976488:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+54:11592:x1874679367294080:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787833845.976627:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.976646:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.976675:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.976702:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.976709:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.976784:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.976790:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833845.976794:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.976802:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.976815:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833845.976818:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787833845.976823:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833845.976828:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833845.976912:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+54:11592:x1874679367294080:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 424us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833845.976990:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:0.0:1787833845.979330:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833845.979674:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367294336 00000100:00100000:2.0:1787833845.979684:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367294336 00000100:00100000:2.0:1787833845.979749:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:2.0:1787833845.979760:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+54:11592:x1874679367294336:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833845.980032:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+55:11592:x1874679367294336:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 273us (721us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787833845.980040:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00010000:00010000:1.0:1787833846.076572:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833846.087425:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.087528:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367294592 00000100:00100000:2.0:1787833846.087537:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367294592 00000100:00100000:2.0:1787833846.087600:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:2.0:1787833846.087611:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+55:11602:x1874679367294592:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787833846.087636:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833846.087639:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787833846.087666:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d98 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.087685:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:2.0:1787833846.087690:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833846.087703:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3dbb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.087802:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.087816:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.087825:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833846.087836:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787833846.087973:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dbb expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.087987:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dbb expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.088015:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833846.088018:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833846.088021:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2800, rc 0) 00000100:00100000:2.0:1787833846.088084:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+56:11602:x1874679367294592:12345-192.168.202.15@tcp:101:bash.0 Request processed in 475us (669us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787833846.088092:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:1.0:1787833846.097707:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.097904:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367294848 00000100:00100000:3.0:1787833846.097949:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367294848 00000100:00100000:3.0:1787833846.098017:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 208 00000100:00100000:3.0:1787833846.098027:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+56:11602:x1874679367294848:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:3.0:1787833846.098087:0:7195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787833846.098117:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2800/0x2bdb54ee5e775b3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dbb expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.098141:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3600/0x2bdb54ee5e775b23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3db4 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.098739:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833846.098747:0:7195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833846.099001:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.099017:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.099029:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833846.099081:0:7195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787833846.099108:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043696074 reply state 0000000015b1330b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.099117:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787833846.099219:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+57:11602:x1874679367294848:12345-192.168.202.15@tcp:36:bash.0 Request processed in 1191us (1519us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787833846.099228:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 208 00000020:00080000:3.0:1787833846.099233:0:7195:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787833846.109830:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.109846:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.109853:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.109859:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440031800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833846.109865:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.109872:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.109888:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833846.109891:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833846.109896:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.109903:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833846.112816:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.113094:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367294976 00000100:00100000:2.0:1787833846.113105:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367294976 00000100:00100000:2.0:1787833846.113158:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:2.0:1787833846.113168:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+56:11602:x1874679367294976:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787833846.113192:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833846.113211:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3dc2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.113328:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.113381:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.113393:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833846.113487:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787833846.113492:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833846.113523:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.113566:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc2 expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.113584:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc2 expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.113594:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833846.113597:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833846.113600:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2e00, rc 0) 00000100:00100000:2.0:1787833846.113669:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+57:11602:x1874679367294976:12345-192.168.202.15@tcp:101:bash.0 Request processed in 501us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833846.113677:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:0.0:1787833846.119711:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.120112:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367295232 00000100:00100000:3.0:1787833846.120123:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367295232 00000100:00100000:3.0:1787833846.120650:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:3.0:1787833846.120662:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+57:11602:x1874679367295232:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:3.0:1787833846.121104:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+58:11602:x1874679367295232:12345-192.168.202.15@tcp:35:bash.0 Request processed in 442us (1402us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787833846.121113:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:0.0:1787833846.213097:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.213180:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367295360 00000100:00100000:3.0:1787833846.213189:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367295360 00000100:00100000:3.0:1787833846.213252:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:3.0:1787833846.213262:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+58:11608:x1874679367295360:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833846.213293:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833846.213323:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3dc9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.213434:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775b69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.213448:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.213460:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833846.213522:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787833846.213526:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833846.213549:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775b69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.213576:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775b62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc9 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.213611:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775b69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc9 expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.213620:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:3.0:1787833846.213624:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787833846.213627:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440030a00, rc 0) 00000100:00100000:3.0:1787833846.213679:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+59:11608:x1874679367295360:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 419us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.213686:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:1.0:1787833846.218768:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.218827:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367295488 00000100:00100000:2.0:1787833846.218837:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367295488 00000100:00100000:2.0:1787833846.218944:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:2.0:1787833846.218955:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+59:11608:x1874679367295488:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833846.218988:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833846.219009:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3dd0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219081:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219096:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219107:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219132:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219140:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219146:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219235:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219242:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219249:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833846.219302:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787833846.219306:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833846.219336:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219397:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219406:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219413:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219430:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219435:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833846.219440:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219447:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219459:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:2.0:1787833846.219463:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833846.219467:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219473:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2a00/0x2bdb54ee5e775b77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219487:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219493:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219507:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219513:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833846.219516:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219532:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219540:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6474279b00) 00010000:00010000:2.0:1787833846.219543:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833846.219546:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219551:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775b7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219584:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775b70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219597:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.219604:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833846.219607:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833846.219609:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3e00, rc 0) 00000100:00100000:2.0:1787833846.219669:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+60:11608:x1874679367295488:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 715us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833846.219675:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:0.0:1787833846.227310:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.227415:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.227511:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367295744 00000100:00100000:3.0:1787833846.227522:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367295744 00000100:00100000:3.0:1787833846.227584:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:3.0:1787833846.227594:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+60:11608:x1874679367295744:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833846.227616:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833846.227639:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775b8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3dd7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.227747:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.227762:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc2 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.227771:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.227790:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.227820:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.227832:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 61 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.227846:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477444b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375671424:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833846.227945:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc2 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.227954:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc2 expref: 61 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.227970:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477447c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375671552:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833846.227991:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833846.228501:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367295872 00000100:00100000:1.0:1787833846.228508:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367295872 00010000:00010000:1.0:1787833846.228546:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 62 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833846.228575:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:1.0:1787833846.228583:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+62:2347:x1874679367295872:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833846.228593:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833846.228598:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 62 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.228611:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 62 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.228631:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833846.228635:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.228642:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.228649:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833846.228693:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+62:2347:x1874679367295872:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 110us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833846.228700:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 78 00010000:00010000:3.0:1787833846.239143:0:5816:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.15@tcp) returned -22 from blocking AST (req@0000000057ce8049 x1874679375671424) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 61 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.239169:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3e00/0x2bdb54ee5e775b85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd0 expref: 61 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.239189:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477444b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375671424:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833846.239834:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477447c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375671552:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833846.239868:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833846.239874:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.239895:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.239904:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.241098:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833846.241952:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367296000 00000100:00100000:1.0:1787833846.241965:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367296000 00010000:00010000:1.0:1787833846.242013:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc2 expref: 61 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833846.242076:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:1.0:1787833846.242086:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477446580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+61:2345:x1874679367296000:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833846.242102:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833846.242109:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc2 expref: 61 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.242135:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc2 expref: 61 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.242157:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2e00/0x2bdb54ee5e775b5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc2 expref: 61 pid: 5817 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.242174:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833846.242179:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.242187:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.242194:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.242214:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833846.242282:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477446580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+60:2345:x1874679367296000:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 197us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833846.242290:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00010000:00010000:2.0:1787833846.244180:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.244195:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833846.244216:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787833846.246049:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd7 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.246083:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd7 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.246092:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833846.246095:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787833846.246099:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c600, rc 0) 00000100:00100000:2.0:1787833846.246221:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+60:11608:x1874679367295744:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 18628us (18921us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787833846.246231:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:3.0:1787833846.257172:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833846.258055:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367296256 00000100:00100000:1.0:1787833846.258098:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367296256 00000100:00100000:1.0:1787833846.258251:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787833846.258262:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477446940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+60:11608:x1874679367296256:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:1.0:1787833846.258287:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833846.258324:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775af2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dad expref: 60 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.258371:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833846.258376:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833846.258443:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477446940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+59:11608:x1874679367296256:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 183us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833846.258451:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787833846.263017:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.263205:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367296384 00000100:00100000:3.0:1787833846.263214:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367296384 00000100:00100000:3.0:1787833846.263285:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:3.0:1787833846.263294:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+59:11608:x1874679367296384:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:3.0:1787833846.263429:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.263448:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.263460:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833846.263668:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787833846.263766:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+59:11608:x1874679367296384:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 473us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.263774:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:3.0:1787833846.266456:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.266574:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367296512 00000100:00100000:0.0:1787833846.266583:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367296512 00000100:00100000:0.0:1787833846.266647:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:0.0:1787833846.266657:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+59:11608:x1874679367296512:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833846.266680:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833846.266701:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775ba8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3dde expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.266789:0:7195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.266800:0:7195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775ba8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dde expref: 60 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.266818:0:7195:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.266831:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775ba8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dde expref: 60 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.266843:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:0.0:1787833846.266846:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833846.266850:0:7195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775ba8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dde expref: 60 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.266857:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e400, rc 0) 00000100:00100000:0.0:1787833846.266921:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+60:11608:x1874679367296512:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 256us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833846.266948:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:2.0:1787833846.335165:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375671680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833846.335239:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.335829:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375671680 00000100:00100000:3.0:1787833846.335838:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375671680 00000100:00100000:3.0:1787833846.335927:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787833846.335946:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375671680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833846.335972:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833846.336030:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375671680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.336038:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787833846.336308:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375671680:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787833846.588646:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833846.588656:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833846.588692:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787833846.588699:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833846.588822:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779dd2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375671808:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787833846.588955:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833846.592853:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779dd2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375671808:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787833846.601955:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.602309:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367296640 00000100:00100000:3.0:1787833846.602329:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367296640 00000100:00100000:3.0:1787833846.602459:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:3.0:1787833846.602469:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+60:11609:x1874679367296640:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787833846.602502:0:5815:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787833846.602650:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+60:11609:x1874679367296640:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 181us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.602657:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:3.0:1787833846.624699:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.624778:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367296768 00000100:00100000:0.0:1787833846.624788:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367296768 00000100:00100000:0.0:1787833846.624853:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:0.0:1787833846.624864:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+60:11609:x1874679367296768:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787833846.624952:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.624969:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.624980:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625033:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625040:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625046:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625069:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625076:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625082:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833846.625135:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787833846.625140:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833846.625150:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625160:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625167:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625173:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625178:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ee00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833846.625182:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625189:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625201:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:0.0:1787833846.625204:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833846.625209:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625215:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775baf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625228:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625256:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625262:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625267:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833846.625270:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625447:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625459:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b646021d300) 00010000:00010000:0.0:1787833846.625462:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833846.625465:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625471:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bb6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625487:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625498:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625503:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625507:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fc00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833846.625516:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625523:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625532:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:0.0:1787833846.625535:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833846.625538:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.625545:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775bbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833846.625726:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+60:11609:x1874679367296768:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 863us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833846.625735:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:1.0:1787833846.628797:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.628898:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367297024 00000100:00100000:0.0:1787833846.628972:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367297024 00000100:00100000:0.0:1787833846.629069:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:0.0:1787833846.629080:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+60:11609:x1874679367297024:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833846.629102:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833846.629125:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775bc4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3de5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.629226:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.629254:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.629286:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833846.629301:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787833846.629842:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.629852:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.629858:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.629875:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833846.629879:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.629887:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.629900:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833846.629902:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787833846.629906:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.630136:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e775bcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.630187:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775bc4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3de5 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.630198:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:1.0:1787833846.630200:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833846.630204:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f800/0x2bdb54ee5e775bc4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3de5 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.630215:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f800, rc 0) 00000100:00100000:1.0:1787833846.631947:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+61:11609:x1874679367297024:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2850us (3142us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787833846.631961:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:1.0:1787833846.635857:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.635945:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367297152 00000100:00100000:0.0:1787833846.635955:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367297152 00000100:00100000:0.0:1787833846.636020:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:0.0:1787833846.636030:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+61:11609:x1874679367297152:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787833846.636069:0:7195:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787833846.636175:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+61:11609:x1874679367297152:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 146us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833846.636182:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:3.0:1787833846.645132:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.645225:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367297408 00000100:00100000:2.0:1787833846.645247:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367297408 00000100:00100000:2.0:1787833846.645336:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:2.0:1787833846.645380:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+61:11609:x1874679367297408:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833846.645404:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833846.645407:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787833846.645435:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775b69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dc9 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.645455:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:2.0:1787833846.645461:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833846.645472:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775bd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3dec expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787833846.645895:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787833846.646093:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775be0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.646107:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.646116:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.646164:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775bd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dec expref: 63 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.646179:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775be0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dec expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.646205:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:2.0:1787833846.646208:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833846.646211:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2600, rc 0) 00000100:00100000:2.0:1787833846.646279:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+62:11609:x1874679367297408:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 902us (1183us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787833846.646287:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:1.0:1787833846.650739:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.656075:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367297664 00000100:00100000:0.0:1787833846.656092:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367297664 00000100:00100000:0.0:1787833846.656179:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:0.0:1787833846.656189:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+62:11609:x1874679367297664:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833846.656251:0:7195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833846.656291:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2600/0x2bdb54ee5e775be0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dec expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656318:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833846.656330:0:7195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833846.656368:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656382:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656407:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656421:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656429:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656436:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656507:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656514:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656520:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656526:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833846.656530:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656536:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656544:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:0.0:1787833846.656547:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833846.656550:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656563:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775bee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656572:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656578:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656582:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656587:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ee00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833846.656590:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656596:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656605:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x975be8d6 (ffff9b646021d300) 00010000:00010000:0.0:1787833846.656607:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833846.656610:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.656615:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775bf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x975be8d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833846.656718:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+61:11609:x1874679367297664:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 529us (5987us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833846.656727:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:0.0:1787833846.659873:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.659927:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367297792 00000100:00100000:2.0:1787833846.659937:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367297792 00000100:00100000:2.0:1787833846.659998:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:2.0:1787833846.660009:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+61:11609:x1874679367297792:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833846.660031:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833846.660053:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775bfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3df3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.660101:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.660116:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.660127:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.660512:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775bfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3df3 expref: 63 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.660531:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3df3 expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.660547:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:2.0:1787833846.660550:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787833846.660554:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3200, rc 0) 00000100:00100000:2.0:1787833846.660909:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+62:11609:x1874679367297792:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 901us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833846.660917:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:2.0:1787833846.682980:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.683076:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367298048 00000100:00100000:0.0:1787833846.683088:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367298048 00000100:00100000:0.0:1787833846.683150:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 222 00000100:00100000:0.0:1787833846.683159:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+62:11609:x1874679367298048:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833846.683240:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.683257:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.683269:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787833846.683642:0:7195:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787833846.683654:0:7195:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325439313184ns, next at 326439310189ns, rc = 0 00000004:00010000:2.0:1787833846.683751:0:7195:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4d90910 reply state 00000000c8eb2aa1 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833846.683762:0:7195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787833846.683859:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+64:11609:x1874679367298048:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 702us (891us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787833846.683866:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 222 00010000:00010000:3.0:1787833846.688931:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.689438:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.689446:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.689453:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ee00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833846.689458:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.689465:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.689485:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:3.0:1787833846.689488:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787833846.689493:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.689522:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e775c0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833846.692149:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833846.692300:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367298176 00000100:00100000:1.0:1787833846.692322:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367298176 00000100:00100000:1.0:1787833846.692411:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 223 00000100:00100000:1.0:1787833846.692422:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+63:11609:x1874679367298176:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833846.692447:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833846.692468:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3dfa expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.692543:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dfa expref: 64 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.692558:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dfa expref: 64 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.692577:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:1.0:1787833846.692580:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833846.692584:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198600, rc 0) 00000100:00100000:1.0:1787833846.692640:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+64:11609:x1874679367298176:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 220us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833846.692647:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 223 00000100:00100000:1.0:1787833846.695804:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.696212:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367298304 00000100:00100000:3.0:1787833846.696222:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367298304 00000100:00100000:3.0:1787833846.696370:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:3.0:1787833846.696383:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+9:2347:x1874679367298304:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787833846.696717:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+10:2347:x1874679367298304:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 336us (921us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787833846.696725:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:0.0:1787833846.699233:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.699335:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367298560 00000100:00100000:2.0:1787833846.699457:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367298560 00000100:00100000:2.0:1787833846.699615:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:2.0:1787833846.699626:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+64:11609:x1874679367298560:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787833846.699859:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+65:11609:x1874679367298560:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 234us (634us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787833846.699867:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:0.0:1787833846.702025:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.702420:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367298816 00000100:00100000:3.0:1787833846.702429:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367298816 00000100:00100000:3.0:1787833846.702484:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 224 00000100:00100000:3.0:1787833846.702493:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+65:11609:x1874679367298816:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787833846.702947:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+65:11609:x1874679367298816:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 454us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.702956:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 224 00000100:00100000:1.0:1787833846.710044:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.710173:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367298944 00000100:00100000:2.0:1787833846.710202:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367298944 00000100:00100000:2.0:1787833846.710260:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00100000:2.0:1787833846.710270:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f939e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+65:11609:x1874679367298944:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833846.710293:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833846.710327:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775c18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e01 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.710706:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e775c1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.710722:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e775c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.710734:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e775c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833846.710771:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833846.710789:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e775c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.710829:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3a00/0x2bdb54ee5e775c18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e01 expref: 67 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.710848:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e775c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e01 expref: 66 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.710856:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:2.0:1787833846.710859:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787833846.710862:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2400, rc 0) 00000100:00100000:2.0:1787833846.710989:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f939e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+66:11609:x1874679367298944:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 720us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833846.711004:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00100000:0.0:1787833846.718207:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.718274:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367299072 00000100:00100000:3.0:1787833846.718282:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367299072 00000100:00100000:3.0:1787833846.718426:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:3.0:1787833846.718435:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+10:2347:x1874679367299072:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833846.718451:0:8382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833846.718471:0:8382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e08 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833846.718510:0:8382:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902df6, blocks: 0x1 00010000:00010000:3.0:1787833846.718534:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1787833846.718538:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833846.718545:0:8382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e08 expref: 11 pid: 8382 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.718559:0:8382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e08 expref: 11 pid: 8382 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.718569:0:8382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c400, rc 0) 00000100:00100000:3.0:1787833846.718889:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+11:2347:x1874679367299072:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 454us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.718894:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:1.0:1787833846.727126:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.727285:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367299328 00000100:00100000:2.0:1787833846.727294:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367299328 00000100:00100000:2.0:1787833846.727387:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 226 00000100:00100000:2.0:1787833846.727397:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+66:11609:x1874679367299328:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787833846.728023:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+66:11609:x1874679367299328:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 626us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833846.728032:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 226 00000100:00100000:1.0:1787833846.732776:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.732869:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367299456 00000100:00100000:2.0:1787833846.732879:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367299456 00000100:00100000:2.0:1787833846.732938:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:2.0:1787833846.732949:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+11:11609:x1874679367299456:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833846.732967:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833846.732985:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e0f expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.733018:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e08 expref: 12 pid: 8382 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.733027:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833846.733031:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833846.733037:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.733071:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e08 expref: 12 pid: 8382 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.733099:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e08 expref: 12 pid: 8382 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833846.733115:0:6659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1874679375671936:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787833846.733218:0:6659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833846.736577:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833846.736672:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367299584 00000100:00100000:1.0:1787833846.736682:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367299584 00010000:00010000:1.0:1787833846.736788:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e08 expref: 13 pid: 8382 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833846.736825:0:6659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca4f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1874679375671936:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787833846.736864:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 13 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.736884:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3a00, rc 0) 00000100:00100000:1.0:1787833846.736907:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:1.0:1787833846.736920:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+13:2344:x1874679367299584:12345-192.168.202.15@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787833846.736949:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+13:11609:x1874679367299456:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 4000us (4180us total) trans 0 rc 0/0 00010000:00010000:1.0:1787833846.736950:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787833846.736962:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00010000:00010000:1.0:1787833846.736981:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e08 expref: 12 pid: 8382 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.736998:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e08 expref: 12 pid: 8382 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.737025:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e08 expref: 12 pid: 8382 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.737041:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833846.737047:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833846.737054:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.737065:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.737099:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833846.737114:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1874679375672064:192.168.202.15@tcp:105: 00000100:00100000:1.0:1787833846.737179:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833846.740887:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5800:1874679375672064:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787833846.740920:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833846.741103:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+11:2344:x1874679367299584:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 4184us (4534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833846.741114:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:1.0:1787833846.753048:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.753171:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367299712 00000100:00100000:3.0:1787833846.753181:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367299712 00002000:00100000:3.0:1787833846.753222:0:6665:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9b647f938780 x1874679367299712/t0(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:652/0 lens 504/0 e 0 to 0 dl 1787833857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833846.753230:0:6665:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b647f938780 with x1874679367299712 ext(0->12) 00002000:00010000:3.0:1787833846.753235:0:6665:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b647f938780 00000100:00100000:3.0:1787833846.753265:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787833846.753274:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:320cb14b-678a-483a-8914-ee446104f369+11:2344:x1874679367299712:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787833846.754650:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:320cb14b-678a-483a-8914-ee446104f369+13:2344:x1874679367299712:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 1368us (1603us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787833846.754672:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00002000:00100000:3.0:1787833846.754681:0:6665:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9b647f938780 x1874679367299712/t4294967320(0) o4->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:652/0 lens 504/448 e 0 to 0 dl 1787833857 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787833846.754690:0:6665:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b647f938780 with x1874679367299712 ext(0->12) 00002000:00010000:3.0:1787833846.754695:0:6665:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b647f938780 00000100:00100000:1.0:1787833846.766577:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.766647:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367299840 00000100:00100000:3.0:1787833846.766657:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367299840 00000100:00100000:3.0:1787833846.766769:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:3.0:1787833846.766780:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+66:11609:x1874679367299840:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787833846.798257:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1787833846.798279:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:2.0:1787833846.798317:0:5838:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1787833846.798358:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787833846.798413:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787833846.798429:0:5838:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b64528cfa80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787833846.798434:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6481ccec00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b64528cf6c0 00000020:00080000:2.0:1787833846.798437:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6481cce000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6477808c00 00000004:00080000:2.0:1787833846.798456:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:2.0:1787833846.798467:0:5838:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b64528cf240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787833846.798485:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b64430aa900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b64528cf300 00000020:00080000:2.0:1787833846.798487:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b64430aaf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6477801800 00000020:00080000:2.0:1787833846.798504:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787833846.798701:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787833846.799157:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+20:11609:x1874679367299840:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 32372us (32586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.799168:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:3.0:1787833846.801733:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.801940:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375672320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787833846.801999:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833846.802403:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375672192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787833846.802437:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833846.802448:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375672448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787833846.803140:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833846.803254:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367299968 00000100:00100000:0.0:1787833846.803263:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367299968 00000100:00100000:0.0:1787833846.803327:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375672320 00000100:00100000:0.0:1787833846.803364:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375672320 00000100:00100000:0.0:1787833846.803379:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375672448 00000100:00100000:0.0:1787833846.803382:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375672448 00000100:00100000:0.0:1787833846.803409:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:0.0:1787833846.803418:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646eff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+13:2345:x1874679367299968:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787833846.803619:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787833846.803628:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3281:x1874679375672320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787833846.803792:0:8382:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787833846.803796:0:8382:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787833846 00002000:00010000:3.0:1787833846.803798:0:8382:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787833846.803800:0:8382:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787833846 -> 1787833846 00002000:00010000:3.0:1787833846.803802:0:8382:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787833846.803863:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375672320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 237us (1863us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787833846.803871:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787833846.803890:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787833846.803905:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1874679375672448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787833846.803920:0:8382:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787833846.803945:0:8382:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a902df5, atime: 0x6a902df5, ctime: 0x6a902df5, blocks: 0x1 00010000:00010000:3.0:1787833846.803953:0:8382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.803969:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1787833846.803973:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833846.803979:0:8382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.803994:0:8382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.804003:0:8382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.804011:0:8382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.804029:0:8382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787833846.804306:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6479ef6d00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787833846.804322:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375672320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787833846.805036:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3283:x1874679375672448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1130us (1896us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787833846.805044:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1787833846.805071:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833846.805078:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.805102:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833846.805262:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.805463:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.805484:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.805492:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.805512:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833846.805514:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833846.805515:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787833846.805587:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b646dca4f00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787833846.805593:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375672448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787833846.807521:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.807607:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375672192 00000100:00100000:3.0:1787833846.807614:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375672192 00000100:00100000:3.0:1787833846.807657:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787833846.807667:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477444f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1874679375672192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787833846.807700:0:8382:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787833846.807867:0:8382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.807888:0:8382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d6e expref: 13 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.807912:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787833846.807916:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833846.807921:0:8382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.807956:0:8382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d6e expref: 13 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.807971:0:8382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d6e expref: 13 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.807985:0:8382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64774461c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8382:1874679375672576:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833846.808103:0:8382:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833846.821872:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833846.821905:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367300096 00000100:00100000:2.0:1787833846.821913:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367300096 00010000:00010000:2.0:1787833846.821953:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d6e expref: 14 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833846.821999:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:2.0:1787833846.822008:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644699a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+14:2345:x1874679367300096:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833846.822022:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833846.822028:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d6e expref: 14 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.822043:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d6e expref: 14 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.822074:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833846.822079:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787833846.822084:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.822108:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.822129:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833846.822181:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644699a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+14:2345:x1874679367300096:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 173us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833846.822189:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00010000:00010000:3.0:1787833846.823628:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b2df1ab/0x2bdb54ee5e7759f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d6e expref: 13 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.823653:0:8382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64774461c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8382:1874679375672576:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833846.823675:0:8382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.823686:0:8382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.823693:0:8382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.823793:0:8382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.823801:0:8382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.823833:0:8382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787833846.825829:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477444f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3280:x1874679375672192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18157us (18309us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787833846.825841:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:3.0:1787833846.825902:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6479ef7840/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787833846.825908:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375672192:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787833846.826729:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833846.826741:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.826753:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833846.826757:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.826767:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.826789:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.826796:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c966f84d/0x2bdb54ee5e775c3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.826817:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833846.826830:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833846.826831:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787833846.858394:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:1.0:1787833846.858411:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1787833846.858429:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1787833846.858435:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1787833846.858703:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646eff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367299968:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 55280us (56974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833846.861043:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:3.0:1787833846.861930:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.862078:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367300352 00000100:00100000:0.0:1787833846.862089:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367300352 00000100:00100000:0.0:1787833846.862149:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 228 00000100:00100000:0.0:1787833846.862159:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+20:11609:x1874679367300352:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833846.862214:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833846.862244:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2400/0x2bdb54ee5e775c1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e01 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.862264:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:0.0:1787833846.862282:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833846.862325:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.862385:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.862415:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833846.862668:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000415680ef reply state 00000000c2081a89 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833846.862678:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833846.863068:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+21:11609:x1874679367300352:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 908us (1141us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787833846.863076:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 228 00000100:00100000:1.0:1787833846.872801:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.873200:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367300480 00000100:00100000:3.0:1787833846.873212:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367300480 00000100:00100000:3.0:1787833846.873284:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:3.0:1787833846.873294:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367300480:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787833846.873542:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787833846.873546:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787833846 -> 1787833846 00002000:00010000:3.0:1787833846.873549:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787833845 00002000:00010000:3.0:1787833846.873551:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787833846 -> 1787833846 00002000:00010000:3.0:1787833846.873554:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787833846.873611:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367300480:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 318us (819us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787833846.873635:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00010000:00010000:2.0:1787833846.875303:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.875330:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.875337:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.875358:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833846.875362:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.875370:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.875387:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:2.0:1787833846.875390:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833846.875395:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833846.875401:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e200/0x2bdb54ee5e775c42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833846.879795:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833846.889379:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367300736 00000100:00100000:1.0:1787833846.889395:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367300736 00000100:00100000:1.0:1787833846.889497:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:1.0:1787833846.889507:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+20:11609:x1874679367300736:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787833846.889573:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.889589:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3df3 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.889597:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.889632:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3df3 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.889647:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3df3 expref: 20 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833846.889662:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375672704:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833846.889765:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833846.892790:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833846.892985:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1874679375672704:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833846.893011:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.893234:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367300864 00000100:00100000:3.0:1787833846.893241:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367300864 00010000:00010000:3.0:1787833846.893291:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3df3 expref: 21 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.893361:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:3.0:1787833846.893372:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+21:2344:x1874679367300864:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833846.893386:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833846.893393:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3df3 expref: 21 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.893404:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3df3 expref: 21 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.893428:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd3200/0x2bdb54ee5e775c03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3df3 expref: 21 pid: 5815 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.893444:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:3.0:1787833846.893449:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.893458:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.893465:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.893500:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833846.893551:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+20:2344:x1874679367300864:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 181us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.893560:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00010000:00010000:0.0:1787833846.893753:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.893761:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.893790:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.893796:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.893802:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.893807:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833846.893811:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.893832:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.893841:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:0.0:1787833846.893844:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787833846.893847:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.893853:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199a00/0x2bdb54ee5e775c49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833846.893892:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+19:11609:x1874679367300736:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 4386us (14107us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787833846.893900:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:1.0:1787833846.900725:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.900976:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367300992 00000100:00100000:3.0:1787833846.900989:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367300992 00000100:00100000:3.0:1787833846.901051:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:3.0:1787833846.901061:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+8:2345:x1874679367300992:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787833846.901109:0:8382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.901132:0:8382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.901140:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833846.901145:0:8382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787833846.901149:0:8382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.901182:0:8382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.901197:0:8382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 8 pid: 6659 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.901214:0:8382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477447840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8382:1874679375672832:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833846.901368:0:8382:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647424f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787833846.905794:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.905848:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367301120 00000100:00100000:0.0:1787833846.905856:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367301120 00010000:00010000:0.0:1787833846.905894:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 9 pid: 6659 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833846.905924:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:0.0:1787833846.905932:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2344:x1874679367301120:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833846.905945:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833846.905966:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 9 pid: 6659 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.905980:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 9 pid: 6659 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.906023:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833846.906028:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833846.906033:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.906043:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.906061:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833846.906114:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:320cb14b-678a-483a-8914-ee446104f369+9:2344:x1874679367301120:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 183us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833846.906121:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00010000:00010000:3.0:1787833846.906702:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da8e79b/0x2bdb54ee5e775c2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e0f expref: 8 pid: 6659 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.906717:0:8382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477447840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8382:1874679375672832:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833846.906738:0:8382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.906747:0:8382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.906754:0:8382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.906777:0:8382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.906785:0:8382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.906793:0:8382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.906800:0:8382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833846.906804:0:8382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.906826:0:8382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.906837:0:8382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.906845:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775c50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.906886:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:320cb14b-678a-483a-8914-ee446104f369+7:2345:x1874679367300992:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 5827us (6182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.906893:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:1.0:1787833846.910219:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.910775:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367301376 00000100:00100000:3.0:1787833846.910785:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367301376 00000100:00100000:3.0:1787833846.910837:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 230 00000100:00100000:3.0:1787833846.910849:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+19:11609:x1874679367301376:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787833846.910926:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.910944:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.910957:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.911173:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.911201:0:7195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dfa expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.911210:0:7195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.911247:0:7195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dfa expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.911263:0:7195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dfa expref: 20 pid: 5817 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.911289:0:7195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477447840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375672960:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833846.911414:0:7195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647424f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833846.916407:0:7195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477447840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375672960:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787833846.916436:0:7195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833846.917062:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000001:00080000:2.0:1787833846.917163:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787833846.917173:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1787833846.917188:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:0.0:1787833846.917291:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367301504 00000100:00100000:0.0:1787833846.917299:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367301504 00010000:00010000:0.0:1787833846.917482:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dfa expref: 21 pid: 5817 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833846.917557:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:0.0:1787833846.917569:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+21:2345:x1874679367301504:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833846.917583:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833846.917590:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dfa expref: 21 pid: 5817 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.917602:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dfa expref: 21 pid: 5817 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.917638:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198600/0x2bdb54ee5e775c11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dfa expref: 21 pid: 5817 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.917652:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:0.0:1787833846.917656:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.917665:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.917672:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.917703:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833846.917773:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+20:2345:x1874679367301504:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 206us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833846.917781:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00010000:00010000:3.0:1787833846.917826:0:7195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.917834:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833846.918073:0:7195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1787833846.918215:0:7195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1787833846.918263:0:7195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1787833846.918374:0:7195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477447840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7195:1874679375673088:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787833846.918437:0:7195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.918473:0:7195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647424f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787833846.918489:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375673088 00000100:00100000:1.0:1787833846.918495:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375673088 00000100:00100000:1.0:1787833846.918539:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833846.918547:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477446d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7195:x1874679375673088:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787833846.918614:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477446d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7195:x1874679375673088:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833846.918621:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787833846.919299:0:7195:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1787833846.919306:0:7195:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1787833846.919337:0:7195:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6479ef6d00, transno 4294967321 00000100:00100000:3.0:1787833846.919387:0:7195:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b6479ef7840 x1874679375672192/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787833862 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833846.919400:0:7195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477447840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7195:1874679375673088:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787833846.919926:0:7195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787833846.920011:0:7195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477447840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7195:1874679375673216:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787833846.920058:0:7195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833846.920083:0:7195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833846.920102:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375673216 00000100:00100000:1.0:1787833846.920109:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375673216 00000100:00100000:1.0:1787833846.920161:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833846.920170:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7195:x1874679375673216:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787833846.920623:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7195:x1874679375673216:12345-0@lo:1000:mdt00_003.0 Request processed in 453us (562us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787833846.920631:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787833846.920836:0:7195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477447840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7195:1874679375673216:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787833846.920871:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.920880:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.920888:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.920894:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833846.920898:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.920906:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.920936:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6474279100) 00010000:00010000:3.0:1787833846.920939:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833846.920943:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.920949:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c400/0x2bdb54ee5e775c5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.921280:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.921289:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.921295:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.921300:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833846.921303:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.921321:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.921330:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833846.921333:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787833846.921372:0:7195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775ba8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dde expref: 23 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.921442:0:7195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775ba8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dde expref: 23 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.921459:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dde expref: 23 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.921492:0:7195:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dde expref: 23 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.921505:0:7195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477447480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375673344:192.168.202.15@tcp:105: 00000100:00100000:3.0:1787833846.921618:0:7195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833846.924505:0:7195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477447480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7195:1874679375673344:192.168.202.15@tcp:105: 00010000:00010000:3.0:1787833846.924539:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924551:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d600/0x2bdb54ee5e775ba1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924585:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924599:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924610:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924621:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924627:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924647:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924653:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440030a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833846.924657:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924665:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924676:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833846.924679:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833846.924683:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924689:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c65 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924699:0:7195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924705:0:7195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924710:0:7195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924715:0:7195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833846.924717:0:7195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924732:0:7195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924739:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833846.924741:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787833846.924744:0:7195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.924749:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c000/0x2bdb54ee5e775c57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833846.924992:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+23:11609:x1874679367301376:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 14144us (14781us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1787833846.925004:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 230 00000020:00080000:3.0:1787833846.925010:0:7195:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787833846.925394:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833846.925399:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833846.926677:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787833846.926691:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833846.926809:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.927003:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367301632 00000100:00100000:3.0:1787833846.927013:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367301632 00000100:00100000:3.0:1787833846.927072:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:3.0:1787833846.927082:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+23:11608:x1874679367301632:12345-192.168.202.15@tcp:49:lfs.0 00000100:00100000:3.0:1787833846.927323:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+23:11608:x1874679367301632:12345-192.168.202.15@tcp:49:lfs.0 Request processed in 242us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.927574:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:2.0:1787833846.932051:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.932108:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367301888 00000100:00100000:0.0:1787833846.932118:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367301888 00000100:00100000:0.0:1787833846.932178:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:0.0:1787833846.932188:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f12850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+23:11609:x1874679367301888:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787833846.932226:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833846.932460:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367302144 00000100:00100000:1.0:1787833846.932469:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367302144 00000100:00100000:1.0:1787833846.932526:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:1.0:1787833846.932536:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+24:11608:x1874679367302144:12345-192.168.202.15@tcp:58:lfs.0 00000040:00080000:1.0:1787833846.932880:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787833846.933175:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+25:11608:x1874679367302144:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 638us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833846.933184:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 231 00000004:00080000:0.0:1787833846.933336:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787833846.935879:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787833846.935959:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.935976:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.935987:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.935996:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.936003:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.936009:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.936067:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787833846.936178:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f12850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+25:11609:x1874679367301888:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 3987us (4135us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787833846.936191:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000020:00080000:1.0:1787833846.936197:0:5819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787833846.940872:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833846.940888:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.940900:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833846.940905:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.940933:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.940953:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6451e01b00) 00010000:00010000:3.0:1787833846.940957:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787833846.940962:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.940968:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199000/0x2bdb54ee5e775c6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.941118:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833846.941121:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833846.941123:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833846.959784:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833846.959878:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367302272 00000100:00100000:0.0:1787833846.959888:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367302272 00000100:00100000:0.0:1787833846.959962:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 232 00000100:00100000:0.0:1787833846.959971:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+25:11611:x1874679367302272:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833846.959998:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833846.960021:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775c73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e16 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.960091:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.960106:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.960118:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.960134:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.960141:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833846.960147:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.960786:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.960803:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd7 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.960813:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.960849:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd7 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.960865:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd7 expref: 26 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833846.960882:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebde00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375673472:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833846.960985:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64440d7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833846.964671:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebde00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1874679375673472:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833846.964715:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833846.964837:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833846.964889:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367302528 00000100:00100000:3.0:1787833846.964895:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367302528 00000100:00100000:3.0:1787833846.964951:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:3.0:1787833846.964961:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+27:5586:x1874679367302528:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787833846.965187:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+28:5586:x1874679367302528:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 228us (352us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787833846.965193:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:2.0:1787833846.969019:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833846.969186:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367302656 00000100:00100000:1.0:1787833846.969196:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367302656 00010000:00010000:1.0:1787833846.969445:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd7 expref: 28 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833846.969528:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:1.0:1787833846.969539:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+28:2344:x1874679367302656:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833846.969556:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833846.969575:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd7 expref: 28 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.969586:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd7 expref: 28 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.969609:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c600/0x2bdb54ee5e775b93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dd7 expref: 28 pid: 5816 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.969625:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833846.969630:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.969638:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.969644:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833846.969681:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833846.969738:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:320cb14b-678a-483a-8914-ee446104f369+27:2344:x1874679367302656:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 202us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833846.969745:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00010000:00010000:3.0:1787833846.969957:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970022:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833846.970069:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787833846.970073:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787833846.970092:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970119:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970128:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970134:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970139:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970144:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833846.970148:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970155:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970164:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:3.0:1787833846.970167:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833846.970171:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970177:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e000/0x2bdb54ee5e775c7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970188:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970195:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970206:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970212:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833846.970214:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970219:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970226:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b646021d000) 00010000:00010000:3.0:1787833846.970228:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833846.970231:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970253:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e775c81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970293:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e775c73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e16 expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970305:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e16 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833846.970323:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833846.970325:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833846.970328:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462198400, rc 0) 00000100:00100000:3.0:1787833846.970411:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+26:11611:x1874679367302272:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 10441us (10637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833846.970427:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 232 00010000:00010000:1.0:1787833847.100533:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787833847.767889:0:12594:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787833847.767900:0:12594:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833847.767945:0:12594:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787833847.767952:0:12594:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787833847.946403:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787833847.946413:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787833847.946466:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787833847.946472:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787833847.946588:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647734e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375673600:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787833847.946691:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601eb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833847.950652:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647734e580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1874679375673600:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787833847.951724:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833847.959537:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367302784 00000100:00100000:1.0:1787833847.959559:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367302784 00000100:00100000:1.0:1787833847.959637:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00100000:1.0:1787833847.959648:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+26:11623:x1874679367302784:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787833847.959684:0:5817:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787833847.959792:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+26:11623:x1874679367302784:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 146us (8074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833847.959800:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00080000:0.0:1787833847.959972:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833847.963010:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833847.963077:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367303040 00000100:00100000:3.0:1787833847.963086:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367303040 00000100:00100000:3.0:1787833847.963153:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 234 00000100:00100000:3.0:1787833847.963162:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+26:11623:x1874679367303040:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833847.963182:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833847.963200:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775c8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e1d expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833847.963310:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833847.963326:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833847.963463:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833847.963476:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787833847.963591:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775c8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e1d expref: 29 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833847.963610:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e1d expref: 28 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833847.963618:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833847.963621:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787833847.963625:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440030a00, rc 0) 00000100:00100000:3.0:1787833847.964155:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:320cb14b-678a-483a-8914-ee446104f369+28:11623:x1874679367303040:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 990us (1151us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787833847.964163:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 234 00000100:00100000:3.0:1787833847.980620:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833847.986185:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367303168 00000100:00100000:1.0:1787833847.986201:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367303168 00000100:00100000:1.0:1787833847.986276:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787833847.986287:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+28:2344:x1874679367303168:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833847.986316:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833847.986366:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440030a00/0x2bdb54ee5e775c96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e1d expref: 28 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.986387:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833847.986393:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833847.986459:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477444000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:320cb14b-678a-483a-8914-ee446104f369+27:2344:x1874679367303168:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 174us (5847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833847.986467:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787833847.998590:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833847.998632:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833847.998656:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833847.998672:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833847.998693:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833847.998742:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367303552 00000100:00100000:2.0:1787833847.998751:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367303552 00000100:00100000:2.0:1787833847.998796:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 295 00000100:00100000:2.0:1787833847.998804:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2346:x1874679367303552:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833847.998871:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2346:x1874679367303552:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833847.998878:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 295 00000100:00100000:2.0:1787833847.998906:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367303808 00000100:00100000:2.0:1787833847.998909:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367303808 00000100:00100000:2.0:1787833847.998938:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367303680 00000100:00100000:2.0:1787833847.998940:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367303680 00000100:00100000:2.0:1787833847.998960:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:2.0:1787833847.998966:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367303808:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833847.998993:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2346:x1874679367303808:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833847.999009:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:2.0:1787833847.999021:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787833847.999026:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2346:x1874679367303680:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833847.999050:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2346:x1874679367303680:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833847.999056:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787833847.999074:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367303424 00000100:00100000:2.0:1787833847.999078:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367303424 00000100:00100000:2.0:1787833847.999099:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367303936 00000100:00100000:2.0:1787833847.999102:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367303936 00000100:00100000:2.0:1787833847.999123:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:2.0:1787833847.999129:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367303936:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833847.999153:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2346:x1874679367303936:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833847.999153:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 235 00000100:00100000:2.0:1787833847.999160:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:1.0:1787833847.999162:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+27:11623:x1874679367303424:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00080000:2.0:1787833847.999175:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787833847.999180:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833847.999182:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787833847.999230:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.999249:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.999268:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.999493:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.999501:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.999508:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.999513:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833847.999517:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.999524:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.999536:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833847.999539:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787833847.999544:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833847.999550:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198000/0x2bdb54ee5e775ca4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833847.999677:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+28:11623:x1874679367303424:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 515us (1097us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787833847.999684:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 235 00000040:00080000:2.0:1787833848.004550:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833848.004560:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833848.005044:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787833848.005053:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833848.013989:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833848.014595:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367304192 00000100:00100000:1.0:1787833848.014603:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367304192 00000100:00100000:1.0:1787833848.014649:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:1.0:1787833848.014656:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+28:11623:x1874679367304192:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787833848.014884:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+29:11623:x1874679367304192:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 228us (907us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787833848.014889:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00010000:00010000:2.0:1787833848.124570:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833848.385801:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833848.385827:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6476ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375673728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833848.385923:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833848.386233:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375673728 00000100:00100000:1.0:1787833848.386241:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375673728 00000100:00100000:1.0:1787833848.386316:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787833848.386325:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874679375673728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833848.386399:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833848.386451:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874679375673728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833848.386458:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787833848.386507:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6476ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375673728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787833848.386733:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787833849.171603:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787833849.699029:0:12645:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833849.699039:0:12645:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833849.699089:0:12645:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787833849.699094:0:12645:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787833850.035201:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833850.035401:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367304448 00000100:00100000:3.0:1787833850.035411:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367304448 00000100:00100000:3.0:1787833850.035492:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 236 00000100:00100000:3.0:1787833850.035504:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+29:11644:x1874679367304448:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787833850.035533:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833850.035557:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775cab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e24 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833850.035667:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775cb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833850.035682:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833850.035695:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787833850.035705:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787833850.035837:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031800/0x2bdb54ee5e775cab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e24 expref: 32 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833850.035855:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e24 expref: 31 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833850.035878:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:3.0:1787833850.035896:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787833850.035900:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031e00, rc 0) 00000100:00100000:3.0:1787833850.036227:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+31:11644:x1874679367304448:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 725us (1037us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787833850.036235:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 236 00000100:00080000:2.0:1787833850.036393:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833850.041173:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833850.041425:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367304576 00000100:00100000:2.0:1787833850.041436:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367304576 00000100:00100000:2.0:1787833850.041498:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 237 00000100:00100000:2.0:1787833850.041508:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477445e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+31:11644:x1874679367304576:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787833850.041592:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833850.041611:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833850.041623:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833850.041651:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833850.041658:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833850.041665:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833850.041671:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833850.041675:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833850.041695:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833850.041707:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:2.0:1787833850.041710:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833850.041714:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833850.041720:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6479dd2200/0x2bdb54ee5e775cc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833850.041806:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477445e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+31:11644:x1874679367304576:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 299us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833850.041813:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 237 00000040:00080000:2.0:1787833850.045043:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833850.045054:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833850.045106:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787833850.045113:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787833850.154499:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833850.154756:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367304704 00000100:00100000:3.0:1787833850.154767:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367304704 00000100:00100000:3.0:1787833850.154894:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:3.0:1787833850.154905:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2346:x1874679367304704:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:3.0:1787833850.154924:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833850.154946:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005718f83/0x2bdb54ee5e775cc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e2b expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787833850.154985:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a902df6, atime: 0x6a902df5, ctime: 0x6a902df6, blocks: 0xb 00010000:00010000:3.0:1787833850.155006:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1787833850.155011:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833850.155021:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005718f83/0x2bdb54ee5e775cc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e2b expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833850.155038:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005718f83/0x2bdb54ee5e775cc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e2b expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833850.155050:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6440031800, rc 0) 00000100:00100000:3.0:1787833850.155106:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+8:2346:x1874679367304704:12345-192.168.202.15@tcp:101:cat.0 Request processed in 204us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833850.155128:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00080000:2.0:1787833850.157863:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833850.159104:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833850.159254:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367304832 00000100:00100000:2.0:1787833850.159264:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367304832 00002000:00100000:2.0:1787833850.159333:0:6664:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9b647734c3c0 x1874679367304832/t0(0) o3->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:656/0 lens 488/0 e 0 to 0 dl 1787833861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787833850.159378:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b647734c3c0 with x1874679367304832 ext(0->4095) 00002000:00010000:2.0:1787833850.159385:0:6664:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b647734c3c0 00000100:00100000:2.0:1787833850.159409:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787833850.159419:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367304832:12345-192.168.202.15@tcp:3:cat.0 00000100:00100000:2.0:1787833850.160538:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:320cb14b-678a-483a-8914-ee446104f369+8:2344:x1874679367304832:12345-192.168.202.15@tcp:3:cat.0 Request processed in 1112us (1435us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787833850.160550:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00002000:00100000:2.0:1787833850.160558:0:6664:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9b647734c3c0 x1874679367304832/t0(0) o3->320cb14b-678a-483a-8914-ee446104f369@192.168.202.15@tcp:656/0 lens 488/4536 e 0 to 0 dl 1787833861 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787833850.160567:0:6664:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9b647734c3c0 with x1874679367304832 ext(0->4095) 00002000:00010000:2.0:1787833850.160573:0:6664:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b647734c3c0 00010000:00010000:1.0:1787833850.172613:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833850.941597:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64774043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375674112:0@lo:400:kworker.0 00000100:00100000:1.0:1787833850.941674:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833850.941760:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833850.941768:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375674240:0@lo:400:kworker.0 00000100:00100000:1.0:1787833850.941797:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833850.941892:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646dca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375673856:0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.941928:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833850.941961:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64590483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375674368:0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.941985:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833850.942007:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787833850.942013:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375673984:0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.942036:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833850.942056:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375674496:0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.942079:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833850.942108:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375674112 00000100:00100000:3.0:1787833850.942115:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375674112 00000100:00100000:3.0:1787833850.942168:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375674368 00000100:00100000:3.0:1787833850.942172:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375674368 00000100:00100000:3.0:1787833850.942186:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375673984 00000100:00100000:3.0:1787833850.942189:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375673984 00000100:00100000:3.0:1787833850.942203:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787833850.942212:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375674112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833850.942374:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375673856 00000100:00100000:1.0:1787833850.942379:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375673856 00000100:00100000:1.0:1787833850.942408:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787833850.942429:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375673856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833850.942467:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375673856:12345-0@lo:400:kworker.0 Request processed in 40us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833850.942474:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787833850.942541:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375674112:12345-0@lo:400:kworker.0 Request processed in 330us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833850.942550:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787833850.942565:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787833850.942571:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477444780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375674368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.942598:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477444780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1874679375674368:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833850.942613:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787833850.942624:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787833850.942629:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375673984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.942656:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375673984:12345-0@lo:400:kworker.0 Request processed in 27us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833850.942661:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787833850.942683:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375674240 00000100:00100000:3.0:1787833850.942686:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375674240 00000100:00100000:3.0:1787833850.942720:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375674496 00000100:00100000:3.0:1787833850.942723:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375674496 00000100:00100000:3.0:1787833850.942745:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787833850.942752:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1874679375674240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.942781:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1874679375674240:12345-0@lo:400:kworker.0 Request processed in 30us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833850.942787:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787833850.942798:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787833850.942804:0:8382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477446580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375674496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.942829:0:8382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477446580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375674496:12345-0@lo:400:kworker.0 Request processed in 26us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833850.942834:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1787833850.942849:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787833850.942852:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787833850.942854:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833850.942886:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375673984:0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.942897:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787833850.942902:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6341fa9a40, transno 4294967307 00000004:00080000:3.0:1787833850.942919:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787833850.942936:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b646dca4f00, transno 4294967310 00000100:00100000:3.0:1787833850.942943:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375674496:0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.942954:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646dca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375673856:0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.942964:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64590483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1874679375674368:0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.943236:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375674240:0@lo:400:kworker.0 00000100:00100000:3.0:1787833850.943248:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64774043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375674112:0@lo:400:kworker.0 00010000:00010000:1.0:1787833851.214100:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833851.452628:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375674624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833851.452705:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833851.452839:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375674624 00000100:00100000:1.0:1787833851.452846:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375674624 00000100:00100000:1.0:1787833851.452899:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787833851.452910:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477446940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375674624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833851.452948:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833851.452999:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477446940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375674624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833851.453007:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787833851.453095:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645904a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375674624:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787833852.041286:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1787833852.041309:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1787833852.088651:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:0.0:1787833852.088679:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:0.0:1787833852.088697:0:5838:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1787833852.088719:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787833852.088731:0:5838:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b647424f3c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787833852.088736:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6481cce500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b64742299c0 00000020:00080000:0.0:1787833852.088739:0:5838:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b6481ccea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b647749d000 00000020:00080000:1.0:1787833852.089106:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787833852.089447:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1787833852.220530:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833853.108708:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833853.108757:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833853.109057:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833853.109095:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833853.109108:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367304960 00000100:00100000:2.0:1787833853.109120:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367304960 00000100:00100000:3.0:1787833853.109128:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833853.109173:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367305472 00000100:00100000:0.0:1787833853.109178:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367305472 00000100:00100000:2.0:1787833853.109183:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 297 00000100:00100000:2.0:1787833853.109197:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367304960:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833853.109233:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367305088 00000100:00100000:0.0:1787833853.109238:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367305088 00000100:00100000:0.0:1787833853.109273:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 156 00000100:00100000:0.0:1787833853.109284:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477444b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2347:x1874679367305472:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833853.109288:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367304960:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 93us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833853.109299:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 297 00000100:00100000:0.0:1787833853.109326:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477444b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:2347:x1874679367305472:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833853.109335:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 156 00000100:00100000:0.0:1787833853.109377:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 157 00000100:00100000:0.0:1787833853.109385:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+18:2347:x1874679367305088:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833853.109417:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+18:2347:x1874679367305088:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833853.109424:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 157 00000100:00080000:0.0:1787833853.109470:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833853.116745:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367305216 00000100:00100000:1.0:1787833853.116764:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367305216 00000100:00080000:0.0:1787833853.117178:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833853.117288:0:8382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367305344 00000100:00100000:1.0:1787833853.117294:0:8382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367305344 00000100:00080000:0.0:1787833853.117403:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833853.117463:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:3.0:1787833853.117476:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477447c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2347:x1874679367305216:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833853.117664:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477447c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2347:x1874679367305216:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 190us (8905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833853.117672:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:3.0:1787833853.117691:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:3.0:1787833853.117698:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367305344:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833853.117723:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367305344:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 27us (8597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833853.117748:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 95 00010000:00010000:1.0:1787833853.244592:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833853.500757:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6459049a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375674752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833853.500859:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833853.501688:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375674752 00000100:00100000:1.0:1787833853.501697:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375674752 00000100:00100000:1.0:1787833853.501772:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787833853.501782:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375674752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833853.501831:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833853.501898:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375674752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833853.501915:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787833853.501957:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787833853.501963:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6479ef7840, transno 4294967322 00000004:00080000:1.0:1787833853.501973:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787833853.502000:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6459049a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375674752:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787833853.505490:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787833854.268714:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833854.667300:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833854.667433:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367305600 00000100:00100000:0.0:1787833854.667444:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367305600 00000100:00100000:0.0:1787833854.667505:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 238 00000100:00100000:0.0:1787833854.667516:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+18:11289:x1874679367305600:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787833854.667623:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:320cb14b-678a-483a-8914-ee446104f369+18:11289:x1874679367305600:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 Request processed in 108us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833854.667630:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 238 00000100:00100000:0.0:1787833854.670915:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833854.673508:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367305856 00000100:00100000:1.0:1787833854.673527:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367305856 00000100:00100000:0.0:1787833854.675827:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:0.0:1787833854.675844:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+18:11289:x1874679367305856:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787833854.677335:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+19:11289:x1874679367305856:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1487us (6421us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787833854.677363:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:3.0:1787833855.030059:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833855.030166:0:7195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367305984 00000100:00100000:0.0:1787833855.030176:0:7195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367305984 00000100:00100000:0.0:1787833855.030379:0:7195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 239 00000100:00100000:0.0:1787833855.030390:0:7195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+5:12095:x1874679367305984:12345-192.168.202.15@tcp:101:lsof.0 00010000:00010000:0.0:1787833855.030411:0:7195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833855.030431:0:7195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775cce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e32 expref: -99 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833855.030512:0:7195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775cd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833855.030526:0:7195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833855.030537:0:7195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833855.032053:0:7195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787833855.032062:0:7195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833855.032171:0:7195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833855.032220:0:7195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e775cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e32 expref: 7 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833855.032250:0:7195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e32 expref: 6 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833855.032259:0:7195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d800) 00010000:00010000:0.0:1787833855.032262:0:7195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833855.032265:0:7195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751fc00, rc 0) 00000100:00100000:0.0:1787833855.032389:0:7195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:12095:x1874679367305984:12345-192.168.202.15@tcp:101:lsof.0 Request processed in 2001us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833855.032397:0:7195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 239 00000100:00080000:3.0:1787833855.040281:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787833855.293333:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833856.060760:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375675008:0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.060846:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833856.060911:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375675520:0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.060938:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833856.060972:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787833856.060979:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64774043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375674880:0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061007:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833856.061027:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a40a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375675392:0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061047:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833856.061074:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375675264:0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061098:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833856.061116:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787833856.061121:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375675136:0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061142:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833856.061172:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375675520 00000100:00100000:1.0:1787833856.061179:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375675520 00000100:00100000:1.0:1787833856.061255:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375675264 00000100:00100000:1.0:1787833856.061273:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375675264 00000100:00100000:1.0:1787833856.061299:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787833856.061307:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375675520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061386:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375675520:12345-0@lo:400:kworker.0 Request processed in 79us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833856.061394:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787833856.061413:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787833856.061419:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64590483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375675264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061466:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64590483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375675264:12345-0@lo:400:kworker.0 Request processed in 47us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833856.061472:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787833856.061497:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375675008 00000100:00100000:1.0:1787833856.061500:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375675008 00000100:00100000:1.0:1787833856.061525:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375675392 00000100:00100000:1.0:1787833856.061528:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375675392 00000100:00100000:1.0:1787833856.061540:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375675136 00000100:00100000:1.0:1787833856.061542:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375675136 00000100:00100000:1.0:1787833856.061556:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787833856.061562:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459049a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375675008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061593:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459049a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375675008:12345-0@lo:400:kworker.0 Request processed in 31us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833856.061599:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787833856.061611:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787833856.061617:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375675392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061646:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375675392:12345-0@lo:400:kworker.0 Request processed in 29us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833856.061651:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787833856.061672:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787833856.061678:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645904b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375675136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061707:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645904b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375675136:12345-0@lo:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833856.061713:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1787833856.061732:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833856.061736:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833856.061739:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833856.061768:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375674880 00000100:00100000:1.0:1787833856.061771:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375675136:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.061774:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375674880 00000100:00100000:1.0:1787833856.061787:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375675264:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.061812:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787833856.061821:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375674880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061829:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a40a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375675392:0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061842:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375675008:0@lo:400:kworker.0 00000100:00100000:1.0:1787833856.061855:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375675520:0@lo:400:kworker.0 00000100:00100000:2.0:1787833856.061862:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3281:x1874679375674880:12345-0@lo:400:kworker.0 Request processed in 42us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833856.061871:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787833856.061881:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64774043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375674880:0@lo:400:kworker.0 00010000:00010000:1.0:1787833856.316568:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833856.572915:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b645a40a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375675648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833856.573000:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833856.573190:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375675648 00000100:00100000:1.0:1787833856.573199:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375675648 00000100:00100000:1.0:1787833856.573258:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787833856.573268:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375675648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833856.573506:0:6662:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833856.573562:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375675648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 295us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833856.573570:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787833856.573729:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b645a40a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375675648:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787833857.125974:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787833857.126005:0:5838:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787833857.126039:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787833857.126053:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787833857.340577:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833858.225865:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833858.225896:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833858.225925:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833858.225941:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833858.225963:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833858.225990:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367306496 00000100:00100000:2.0:1787833858.226000:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367306496 00000100:00100000:2.0:1787833858.226056:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367306368 00000100:00100000:2.0:1787833858.226059:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367306368 00000100:00100000:2.0:1787833858.226083:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:2.0:1787833858.226092:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367306496:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833858.226161:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2347:x1874679367306496:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833858.226169:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:2.0:1787833858.226186:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:2.0:1787833858.226192:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2347:x1874679367306368:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833858.226229:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+7:2347:x1874679367306368:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833858.226235:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:2.0:1787833858.226259:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367306240 00000100:00100000:2.0:1787833858.226263:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367306240 00000100:00100000:2.0:1787833858.226297:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367306624 00000100:00100000:2.0:1787833858.226300:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367306624 00000100:00100000:2.0:1787833858.226320:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 161 00000100:00100000:2.0:1787833858.226336:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6476ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+18:2347:x1874679367306240:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833858.226395:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6476ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:320cb14b-678a-483a-8914-ee446104f369+18:2347:x1874679367306240:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 61us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833858.226403:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 161 00000100:00100000:2.0:1787833858.226415:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00100000:2.0:1787833858.226421:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:2347:x1874679367306624:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787833858.226442:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:2347:x1874679367306624:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 22us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833858.226447:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00080000:2.0:1787833858.226463:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787833858.226467:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833858.226468:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833858.226654:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367306112 00000100:00100000:0.0:1787833858.226659:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367306112 00000100:00100000:0.0:1787833858.226693:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 299 00000100:00100000:0.0:1787833858.226700:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367306112:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833858.226734:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2347:x1874679367306112:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833858.226740:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 299 00000001:02000400:2.0:1787833858.258914:0:12847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:30:57 (1787833857) 00010000:00010000:1.0:1787833858.365706:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833858.621458:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375675776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833858.621531:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833858.621672:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375675776 00000100:00100000:1.0:1787833858.621679:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375675776 00000100:00100000:1.0:1787833858.621736:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787833858.621745:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375675776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833858.621775:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833858.621816:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375675776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833858.621823:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787833858.621873:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833858.621908:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375675776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787833859.391464:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787833860.284585:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787833860.284595:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787833860.285624:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787833860.285635:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787833860.417677:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833861.180564:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375675904:0@lo:400:kworker.0 00000100:00100000:1.0:1787833861.180646:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833861.180758:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375675904 00000100:00100000:2.0:1787833861.180765:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375675904 00000100:00100000:2.0:1787833861.180819:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787833861.180828:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375675904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.180976:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375676032:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.181011:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.181054:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375676032 00000100:00100000:0.0:1787833861.181057:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375676032 00000100:00100000:0.0:1787833861.181086:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787833861.181093:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375676032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.181142:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375676032:12345-0@lo:400:kworker.0 Request processed in 37us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.181149:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787833861.181208:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375676032:0@lo:400:kworker.0 00000100:00100000:2.0:1787833861.181450:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375675904:12345-0@lo:400:kworker.0 Request processed in 622us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833861.181457:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787833861.181656:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375676288:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.181687:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.181717:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833861.181723:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375676160:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.181743:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.181766:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375676544:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.181788:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.181816:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833861.181822:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375676416:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.181846:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833861.181871:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375676160 00000100:00100000:0.0:1787833861.181875:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375676160 00000100:00100000:0.0:1787833861.181906:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375676416 00000100:00100000:0.0:1787833861.181910:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375676416 00000100:00100000:0.0:1787833861.181930:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787833861.181937:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645a40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375676160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.181973:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645a40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874679375676160:12345-0@lo:400:kworker.0 Request processed in 37us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.181979:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787833861.181992:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787833861.181998:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375676416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.182030:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1874679375676416:12345-0@lo:400:kworker.0 Request processed in 33us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.182036:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787833861.182066:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375676160:0@lo:400:kworker.0 00000100:00100000:0.0:1787833861.182091:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1874679375676416:0@lo:400:kworker.0 00000100:00100000:3.0:1787833861.182168:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375676288 00000100:00100000:3.0:1787833861.182173:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375676288 00000100:00100000:3.0:1787833861.182219:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375676544 00000100:00100000:3.0:1787833861.182222:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375676544 00000100:00100000:3.0:1787833861.182245:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787833861.182253:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477434780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375676288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833861.182294:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477434780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375676288:12345-0@lo:400:kworker.0 Request processed in 43us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833861.182300:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787833861.182312:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787833861.182317:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375676544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833861.182368:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375676544:12345-0@lo:400:kworker.0 Request processed in 51us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833861.182373:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787833861.182399:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375676288:0@lo:400:kworker.0 00000100:00100000:3.0:1787833861.182418:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375676544:0@lo:400:kworker.0 00000100:00080000:2.0:1787833861.182649:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787833861.182654:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833861.182657:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833861.182721:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375675904:0@lo:400:kworker.0 00010000:00010000:1.0:1787833861.436581:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833861.692765:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375676672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833861.692846:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833861.692992:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375676672 00000100:00100000:1.0:1787833861.693000:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375676672 00000100:00100000:1.0:1787833861.693068:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787833861.693078:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375676672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833861.693117:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833861.693173:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375676672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833861.693191:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787833861.693616:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375676672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787833861.739683:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833861.739859:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367306880 00000100:00100000:0.0:1787833861.739870:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367306880 00000100:00100000:0.0:1787833861.739954:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00080000:2.0:1787833861.740053:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833861.740138:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+18:12316:x1874679367306880:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:0.0:1787833861.740818:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+19:12316:x1874679367306880:12345-192.168.202.15@tcp:35:umount.0 Request processed in 852us (1144us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787833861.740835:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:0.0:1787833861.748913:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833861.749080:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367307136 00000100:00100000:1.0:1787833861.749090:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367307136 00000100:00100000:1.0:1787833861.749173:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:1.0:1787833861.749194:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+19:12316:x1874679367307136:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:1.0:1787833861.749642:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:320cb14b-678a-483a-8914-ee446104f369+20:12316:x1874679367307136:12345-192.168.202.15@tcp:35:umount.0 Request processed in 449us (740us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787833861.749650:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:2.0:1787833861.752631:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833861.753154:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367307392 00000100:00100000:0.0:1787833861.753166:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367307392 00000100:00100000:0.0:1787833861.753252:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:0.0:1787833861.753263:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6468f13850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+20:12316:x1874679367307392:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:0.0:1787833861.753763:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6468f13850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+21:12316:x1874679367307392:12345-192.168.202.15@tcp:35:umount.0 Request processed in 501us (1141us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787833861.753773:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:3.0:1787833861.755425:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833861.755528:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367307648 00000100:00100000:0.0:1787833861.755534:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367307648 00000100:00100000:0.0:1787833861.755612:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787833861.755619:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+21:12316:x1874679367307648:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:0.0:1787833861.755890:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:320cb14b-678a-483a-8914-ee446104f369+22:12316:x1874679367307648:12345-192.168.202.15@tcp:35:umount.0 Request processed in 271us (473us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787833861.755896:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:2.0:1787833861.757818:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833861.757848:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833861.757902:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367307776 00000100:00100000:0.0:1787833861.757910:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367307776 00000100:00100000:0.0:1787833861.757962:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367307904 00000100:00100000:0.0:1787833861.757965:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367307904 00000100:00100000:0.0:1787833861.757983:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787833861.757992:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+14:2344:x1874679367307776:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833861.758007:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833861.758028:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440030c00/0x2bdb54ee5e774d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39bd expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833861.758061:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833861.758106:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+13:2344:x1874679367307776:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 116us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.758111:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787833861.758124:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787833861.758128:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446998050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+12:2344:x1874679367307904:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833861.758135:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833861.758142:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c82c00/0x2bdb54ee5e774cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3985 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833861.758153:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833861.758170:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446998050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+11:2344:x1874679367307904:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 41us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833861.758185:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:2.0:1787833861.760604:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833861.760689:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367308032 00000100:00100000:3.0:1787833861.760698:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367308032 00000100:00100000:3.0:1787833861.760831:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:3.0:1787833861.760841:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+5:2343:x1874679367308032:12345-192.168.202.15@tcp:9:umount.0 00000020:00000080:3.0:1787833861.760887:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e775025 00000100:00080000:3.0:1787833861.760895:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b6481736800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787833861.760938:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787833861.761232:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:320cb14b-678a-483a-8914-ee446104f369+2:2343:x1874679367308032:12345-192.168.202.15@tcp:9:umount.0 Request processed in 392us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833861.761240:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00010000:00010000:3.0:1787833861.761261:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833861.761333:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833861.761434:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367308160 00000100:00100000:3.0:1787833861.761439:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367308160 00000100:00100000:3.0:1787833861.761474:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787833861.761481:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477617480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+11:2344:x1874679367308160:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833861.761491:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833861.761510:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83600/0x2bdb54ee5e774f61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a88 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833861.761525:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833861.761773:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477617480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2344:x1874679367308160:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 292us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833861.761781:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00080000:2.0:1787833861.761839:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833861.771590:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833861.771714:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367308544 00000100:00100000:2.0:1787833861.771725:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367308544 00000100:00100000:2.0:1787833861.771815:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:2.0:1787833861.771826:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+7:2343:x1874679367308544:12345-192.168.202.15@tcp:9:umount.0 00000020:00000080:2.0:1787833861.771857:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e77528d 00000020:00010000:2.0:1787833861.771864:0:6661:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b647f899000: total 0 00000100:00080000:2.0:1787833861.771869:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9b647f89f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787833861.771914:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787833861.772218:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:320cb14b-678a-483a-8914-ee446104f369+5:2343:x1874679367308544:12345-192.168.202.15@tcp:9:umount.0 Request processed in 394us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833861.772228:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00000020:00010000:1.0:1787833861.772385:0:6674:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b647f899000: total 0 00010000:00010000:1.0:1787833861.772419:0:6674:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b647f899000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787833861.772482:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b7b96dd/0x2bdb54ee5e775629 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c5d expref: 4 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.772519:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005718f83/0x2bdb54ee5e775cc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e2b expref: 3 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.772534:0:6674:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b647f899000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787833861.772545:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833861.772547:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833861.772548:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787833861.772612:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833861.787819:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833861.788231:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367309568 00000100:00100000:2.0:1787833861.788242:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367309568 00000100:00100000:2.0:1787833861.789230:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 240 00000100:00100000:2.0:1787833861.789242:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+22:2343:x1874679367309568:12345-192.168.202.15@tcp:39:umount.0 00000020:00000080:2.0:1787833861.789292:0:5816:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774cc1 00000020:00010000:2.0:1787833861.789311:0:5816:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b6450235800: total 0 00000100:00080000:2.0:1787833861.789316:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9b634304b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787833861.789372:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787833861.789782:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:320cb14b-678a-483a-8914-ee446104f369+21:2343:x1874679367309568:12345-192.168.202.15@tcp:39:umount.0 Request processed in 540us (1971us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787833861.789790:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 240 00000020:00010000:1.0:1787833861.789909:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b6450235800: total 0 00010000:00010000:1.0:1787833861.789956:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b6450235800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787833861.789992:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:1.0:1787833861.789996:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833861.790007:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ea00/0x2bdb54ee5e77550a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c10 expref: 20 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790026:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833861.790029:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787833861.790033:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2c800/0x2bdb54ee5e774ffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ab2 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790062:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833861.790065:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833861.790069:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e400/0x2bdb54ee5e775ba8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3dde expref: 18 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790084:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833861.790086:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787833861.790089:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7756a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c80 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790101:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279600) 00010000:00010000:1.0:1787833861.790103:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833861.790107:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e774fa7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a9d expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790123:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d800) 00010000:00010000:1.0:1787833861.790125:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833861.790129:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77568b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c79 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790139:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833861.790141:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787833861.790144:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6440031e00/0x2bdb54ee5e775cb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e24 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790157:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:1.0:1787833861.790159:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833861.790171:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7755ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c48 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790196:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6451e01d00) 00010000:00010000:1.0:1787833861.790198:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787833861.790202:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199800/0x2bdb54ee5e775614 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3c56 expref: 12 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790217:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b645a7d3300) 00010000:00010000:1.0:1787833861.790219:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833861.790222:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198400/0x2bdb54ee5e775c88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e16 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790236:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b646021d200) 00010000:00010000:1.0:1787833861.790239:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833861.790242:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462198c00/0x2bdb54ee5e775986 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3d52 expref: 10 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790258:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b645a7d3500) 00010000:00010000:1.0:1787833861.790261:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833861.790265:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6462199600/0x2bdb54ee5e7752e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3b84 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790278:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b645a7d3400) 00010000:00010000:1.0:1787833861.790281:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833861.790284:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6442a2d000/0x2bdb54ee5e774f8b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a96 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833861.790297:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b6450235800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787833861.790316:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833861.790318:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833861.790320:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787833862.273787:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:0.0:1787833862.273797:0:7626:0:(genops.c:885:class_export_put()) final put ffff9b6481737800/320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:3.0:1787833862.273920:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6481737800/320cb14b-678a-483a-8914-ee446104f369 for lustre-OST0001 00000020:00000080:3.0:1787833862.273983:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6481736800 for lustre-OST0001 00000001:00080000:1.0:1787833862.281260:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1787833862.281858:0:5838:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000001:00080000:1.0:1787833862.281869:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787833862.281872:0:5838:0:(genops.c:885:class_export_put()) final put ffff9b6450235800/320cb14b-678a-483a-8914-ee446104f369 00000001:00100000:1.0:1787833862.281897:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:1.0:1787833862.281900:0:6686:0:(genops.c:885:class_export_put()) final put ffff9b647f899000/320cb14b-678a-483a-8914-ee446104f369 00000020:00000080:2.0:1787833862.281951:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6450235800/320cb14b-678a-483a-8914-ee446104f369 for lustre-MDT0000 00000020:00000080:2.0:1787833862.282026:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b647f899000/320cb14b-678a-483a-8914-ee446104f369 for lustre-OST0000 00000020:00000080:2.0:1787833862.282056:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b634304b800 for lustre-MDT0000 00000020:00000080:2.0:1787833862.282060:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b647f89f800 for lustre-OST0000 00010000:00010000:3.0:1787833862.463527:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833863.099371:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833863.099414:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833863.099445:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367309696 00000100:00100000:0.0:1787833863.099452:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833863.099456:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367309696 00000100:00100000:1.0:1787833863.099519:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367309952 00000100:00100000:1.0:1787833863.099522:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367309952 00000100:00100000:1.0:1787833863.099534:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367309824 00000100:00100000:1.0:1787833863.099537:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367309824 00000100:00100000:1.0:1787833863.099553:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:1.0:1787833863.099561:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7dee5a5-62c8-47df-824e-7aea04306fca+12:2347:x1874679367309696:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833863.099577:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833863.099596:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440030200/0x2bdb54ee5e774d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39d2 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833863.099614:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833863.099683:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7dee5a5-62c8-47df-824e-7aea04306fca+11:2347:x1874679367309696:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 121us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833863.099691:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:1.0:1787833863.099710:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:1.0:1787833863.099716:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7dee5a5-62c8-47df-824e-7aea04306fca+10:2347:x1874679367309952:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833863.099723:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833863.099749:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c82000/0x2bdb54ee5e774f5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3a81 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833863.099761:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833863.099783:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7dee5a5-62c8-47df-824e-7aea04306fca+9:2347:x1874679367309952:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 68us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833863.099790:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:1.0:1787833863.099806:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:1.0:1787833863.099814:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7dee5a5-62c8-47df-824e-7aea04306fca+8:2347:x1874679367309824:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833863.099822:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833863.099833:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2d200/0x2bdb54ee5e774d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39fc expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833863.099842:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833863.099860:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7dee5a5-62c8-47df-824e-7aea04306fca+7:2347:x1874679367309824:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 47us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833863.099868:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787833863.107045:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833863.108528:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367310208 00000100:00100000:0.0:1787833863.108541:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367310208 00000100:00100000:0.0:1787833863.108696:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 241 00000100:00100000:0.0:1787833863.108723:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64772da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+6:2343:x1874679367310208:12345-192.168.202.15@tcp:39:umount.0 00000020:00000080:0.0:1787833863.108783:0:5817:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774da8 00000020:00010000:0.0:1787833863.108791:0:5817:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b634133e000: total 0 00000100:00080000:0.0:1787833863.108796:0:5817:0:(import.c:65:import_set_state_nolock()) ffff9b634133b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787833863.108829:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1787833863.108861:0:6674:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b634133e000: total 0 00010000:00010000:1.0:1787833863.108867:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833863.108915:0:6674:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b634133e000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787833863.108949:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021d800) 00010000:00010000:1.0:1787833863.108953:0:6674:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787833863.108962:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e775cd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e32 expref: 5 pid: 7195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833863.109201:0:6674:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b634133e000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787833863.109215:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833863.109217:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833863.109226:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833863.109282:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64772da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f29a9da7-4b51-4740-bbc6-5079429f87b0+3:2343:x1874679367310208:12345-192.168.202.15@tcp:39:umount.0 Request processed in 561us (2247us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787833863.109292:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 241 00000100:00080000:2.0:1787833863.111065:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833863.132554:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833863.133554:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367310464 00000100:00100000:2.0:1787833863.133566:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367310464 00000100:00100000:2.0:1787833863.133624:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 301 00000100:00100000:2.0:1787833863.133635:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+7:2343:x1874679367310464:12345-192.168.202.15@tcp:251:umount.0 00000020:00000080:2.0:1787833863.133680:0:5810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774c9e 00000020:00010000:2.0:1787833863.133688:0:5810:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b6450232800: total 0 00000100:00080000:2.0:1787833863.133693:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9b6450237000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787833863.133780:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7dee5a5-62c8-47df-824e-7aea04306fca+3:2343:x1874679367310464:12345-192.168.202.15@tcp:251:umount.0 Request processed in 147us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833863.133788:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 301 00000020:00010000:1.0:1787833863.134576:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b6450232800: total 0 00010000:00010000:1.0:1787833863.134622:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b6450232800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787833863.134657:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440031200/0x2bdb54ee5e774d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe39c4 expref: 2 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833863.134672:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b6450232800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787833863.134681:0:5803:0:(genops.c:885:class_export_put()) final put ffff9b6450232800/c7dee5a5-62c8-47df-824e-7aea04306fca 00010000:00010000:1.0:1787833863.134701:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833863.134704:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833863.134705:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787833863.134746:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6450232800/c7dee5a5-62c8-47df-824e-7aea04306fca for MGS 00000020:00000080:3.0:1787833863.134786:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6450237000 for MGS 00010000:00010000:3.0:1787833863.484489:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833863.741889:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833863.741912:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375676800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787833863.741984:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833863.742615:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375676800 00000100:00100000:2.0:1787833863.742626:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375676800 00000100:00100000:2.0:1787833863.742699:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787833863.742710:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dca52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375676800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833863.742760:0:6663:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833863.742814:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dca52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375676800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833863.742822:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787833863.742872:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833863.742911:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375676800:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787833864.510467:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787833864.788447:0:13048:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787833864.817781:0:13048:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787833864.817833:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.817849:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.817857:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.817863:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.817890:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787833864.817895:0:13048:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787833864.817921:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787833864.817926:0:13048:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787833864.817932:0:13048:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787833864.817969:0:13048:0:(import.c:65:import_set_state_nolock()) ffff9b64773a2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787833864.818045:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375676928:0@lo:39:umount.0 00000100:00100000:3.0:1787833864.818122:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833864.818236:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375676928 00000100:00100000:0.0:1787833864.818243:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375676928 00000100:00100000:0.0:1787833864.818294:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787833864.818303:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647734d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874679375676928:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787833864.818328:0:5816:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774abb 00000100:00080000:0.0:1787833864.818337:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9b646ef7b800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787833864.818452:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833864.818460:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.818469:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82400 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833864.818473:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.818481:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833864.818489:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833864.818494:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787833864.818496:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787833864.818499:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787833864.818524:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.818545:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833864.818562:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.818569:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82400/0x2bdb54ee5e774d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d2a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.818582:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833864.818583:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833864.818585:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833864.818596:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375677056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833864.818628:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833864.820391:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647734d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3279:x1874679375676928:12345-0@lo:39:umount.0 Request processed in 2080us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833864.820405:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787833864.820422:0:5816:0:(genops.c:885:class_export_put()) final put ffff9b646ef79800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787833864.820549:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b646ef79800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787833864.820604:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b646ef7b800 for lustre-MDT0000 00010000:00010000:0.0:1787833864.823415:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833864.823486:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375677056 00000100:00100000:2.0:1787833864.823499:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375677056 00000100:00100000:2.0:1787833864.823584:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833864.823595:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3280:x1874679375677056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833864.823611:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833864.823646:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440031000/0x2bdb54ee5e774d2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774d23 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.823667:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833864.823747:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3280:x1874679375677056:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (5118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833864.823754:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787833864.823879:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375677056:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787833864.825121:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b64773a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787833864.825190:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375676928:0@lo:39:umount.0 00000100:00080000:2.0:1787833864.830218:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787833864.830228:0:13048:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787833864.830235:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787833864.833860:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.833880:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.833888:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.833895:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.833916:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833864.833923:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.833929:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.833935:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.834243:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833864.834251:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.834258:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83c00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833864.834262:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.834271:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833864.834277:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833864.834291:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787833864.834293:0:6674:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787833864.834331:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.834419:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787833864.834473:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375677184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787833864.834558:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787833864.834633:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.834642:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c83c00/0x2bdb54ee5e774d31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d38 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.834657:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833864.834659:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833864.834661:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833864.834676:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375677184 00000100:00100000:1.0:1787833864.834683:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375677184 00000100:00100000:1.0:1787833864.834734:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833864.834744:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3281:x1874679375677184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833864.834758:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833864.834772:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440031400/0x2bdb54ee5e774d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774d31 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.834784:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787833864.834856:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.834873:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833864.834880:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.834888:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.834895:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.834901:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.834914:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787833864.834920:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.834927:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.834933:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.834939:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.834972:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1787833864.834976:0:13048:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787833864.834980:0:13048:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787833864.835078:0:13048:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787833864.835082:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787833864.835087:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833864.835093:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1787833864.835098:0:13048:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b6341339800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787833864.835103:0:13048:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b64451ca000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787833864.835111:0:13048:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9b634133e000 f29a9da7-4b51-4740-bbc6-5079429f87b0 192.168.202.15@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787833864.835116:0:13048:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9b6477a9ced8) has exports, disconnecting them 00000020:00080000:2.0:1787833864.835120:0:13048:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b6341339800), last request at 1787833861 00000020:00000080:2.0:1787833864.835127:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774c20 00000100:00080000:2.0:1787833864.835143:0:13048:0:(import.c:65:import_set_state_nolock()) ffff9b634133a000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787833864.835200:0:13048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6341339800): rc 0 00000020:00000080:2.0:1787833864.835203:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6341339800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787833864.835214:0:13048:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b64451ca000), last request at 1787833861 00000020:00000080:2.0:1787833864.835218:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774b55 00000100:00080000:2.0:1787833864.835223:0:13048:0:(import.c:65:import_set_state_nolock()) ffff9b64451c8800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787833864.835230:0:13048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b64451ca000): rc 0 00000020:00000080:2.0:1787833864.835232:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b64451ca000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787833864.835238:0:13048:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc19742b6fae0 00000100:00080000:2.0:1787833864.835256:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787833864.835260:0:13048:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1787833864.835271:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787833864.835366:0:13048:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787833864.835382:0:13048:0:(import.c:65:import_set_state_nolock()) ffff9b647fa67000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787833864.835400:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787833864.835403:0:13048:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787833864.835412:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787833864.835473:0:13048:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787833864.835482:0:13048:0:(import.c:65:import_set_state_nolock()) ffff9b647f899800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787833864.835508:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b6477a9ced8) has no exports 00000100:00100000:3.0:1787833864.835659:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375677312:0@lo:9:umount.0 00000100:00100000:3.0:1787833864.835698:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833864.835729:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375677440:0@lo:9:umount.0 00000100:00100000:3.0:1787833864.835749:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833864.839612:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375677312 00000100:00100000:2.0:1787833864.839626:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375677312 00000100:00100000:2.0:1787833864.839674:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375677440 00000100:00100000:2.0:1787833864.839677:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375677440 00000100:00100000:2.0:1787833864.839716:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787833864.839727:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1874679375677312:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787833864.839756:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774ba2 00000100:00080000:2.0:1787833864.839765:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9b64451ce000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787833864.839796:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787833864.840176:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787833864.840185:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460343840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1874679375677440:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787833864.840199:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774c89 00000100:00080000:3.0:1787833864.840204:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9b634182c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787833864.840221:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787833864.840507:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460343840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3279:x1874679375677440:12345-0@lo:9:umount.0 Request processed in 323us (4755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833864.840516:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787833864.840581:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b647f899800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787833864.840588:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787833864.840590:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787833864.840594:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375677440:0@lo:9:umount.0 00000100:00100000:2.0:1787833864.840836:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3279:x1874679375677312:12345-0@lo:9:umount.0 Request processed in 1111us (5136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833864.840843:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787833864.840911:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b647fa67000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787833864.840926:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787833864.840928:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787833864.840931:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375677312:0@lo:9:umount.0 00000100:00080000:0.0:1787833864.841183:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1787833864.841196:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6341339800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787833864.841253:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64451ca000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787833864.841288:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b634133a000 for lustre-MDT0000 00000020:00000080:0.0:1787833864.841293:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b64451c8800 for lustre-MDT0000 00010000:00010000:0.0:1787833864.841304:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787833864.841312:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841321:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2cc00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833864.841325:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841335:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833864.841366:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833864.841371:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787833864.841374:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787833864.841377:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787833864.841413:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841420:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833864.841438:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841445:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2cc00/0x2bdb54ee5e774c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774c5f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841477:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787833864.841481:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841487:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c200 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833864.841490:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841497:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833864.841503:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833864.841508:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787833864.841510:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787833864.841512:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787833864.841526:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841532:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833864.841538:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833864.841677:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647745c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375677568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833864.841728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833864.841772:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833864.841779:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6341fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375677696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833864.841800:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833864.841860:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787833864.841869:0:5800:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787833864.841912:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c200/0x2bdb54ee5e774f4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774f53 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841922:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833864.841926:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.841937:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6482045000 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833864.841940:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.842069:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833864.842077:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833864.842083:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787833864.842086:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787833864.842088:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787833864.842104:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.842110:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833864.842118:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.842124:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6482045000/0x2bdb54ee5e774a0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774a13 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833864.842136:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833864.842138:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833864.842139:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833864.842368:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375677568 00000100:00100000:3.0:1787833864.842374:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375677568 00000100:00100000:3.0:1787833864.842411:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787833864.842417:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375677696 00000100:00100000:3.0:1787833864.842420:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375677696 00000100:00100000:2.0:1787833864.842560:0:13049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787833864.842570:0:13049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6446999050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b866019b-748d-45d1-b7c8-b21ed54e15f4+19:3282:x1874679375677568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833864.842583:0:13049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833864.842596:0:13049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462198e00/0x2bdb54ee5e774c5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774c58 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.842611:0:13049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833864.842654:0:13049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6446999050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b866019b-748d-45d1-b7c8-b21ed54e15f4+18:3282:x1874679375677568:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833864.842672:0:13049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787833864.842689:0:13049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787833864.842696:0:13049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b866019b-748d-45d1-b7c8-b21ed54e15f4+17:3282:x1874679375677696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833864.842704:0:13049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833864.842712:0:13049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2ce00/0x2bdb54ee5e774f53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774f4c expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833864.842721:0:13049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833864.842744:0:13049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b866019b-748d-45d1-b7c8-b21ed54e15f4+16:3282:x1874679375677696:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833864.842750:0:13049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833864.842907:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6341fab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375677696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833864.842917:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647745c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375677568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833864.843166:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:3281:x1874679375677184:12345-0@lo:103:ldlm_bl.0 Request processed in 8422us (8606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833864.843174:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787833864.843215:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833864.843323:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375677824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833864.843389:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833864.843428:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375677824 00000100:00100000:1.0:1787833864.843433:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375677824 00000100:00100000:1.0:1787833864.843463:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787833864.843469:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+15:3280:x1874679375677824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833864.843477:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833864.843486:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6482044800/0x2bdb54ee5e774a13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774a0c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833864.843498:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833864.843524:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:3280:x1874679375677824:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833864.843529:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787833864.843565:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375677824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833864.843587:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833864.844774:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375677184:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787833864.848795:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b6477a9ced8) has no exports 00000020:00000080:2.0:1787833864.922803:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774a67 00000020:00000080:2.0:1787833864.922820:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6445081800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787833864.922881:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787833864.922967:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787833864.922979:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787833864.923009:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9b6477a9b490) has no exports 00000020:00000080:0.0:1787833864.923331:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774a60 00000020:00000080:0.0:1787833864.923337:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b646ef68800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787833864.923771:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6445081800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787833864.923925:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b646ef68800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787833864.923974:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787833864.923982:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787833864.923985:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b646ef6f800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787833864.923987:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff9b646ef6f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787833864.923992:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1787833865.532513:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833866.300697:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375678208:0@lo:400:kworker.0 00000100:00100000:1.0:1787833866.300745:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833866.300764:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375677952:0@lo:400:kworker.0 00000100:00100000:0.0:1787833866.300774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833866.300815:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833866.300841:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833866.300850:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64779de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375678080:0@lo:400:kworker.0 00000100:00100000:1.0:1787833866.300878:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375678208 00000100:00100000:0.0:1787833866.300878:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833866.300887:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375678208 00000100:00100000:2.0:1787833866.300896:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375677952 00000100:00100000:2.0:1787833866.300902:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375677952 00000100:00100000:0.0:1787833866.300914:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375678080 00000100:00100000:0.0:1787833866.300919:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375678080 00000100:00100000:2.0:1787833866.300951:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787833866.300956:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787833866.300964:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:3280:x1874679375677952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833866.300966:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64779dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3283:x1874679375678208:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787833866.300977:0:5817:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787833866.301037:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64779dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3283:x1874679375678208:12345-0@lo:400:kworker.0 Request processed in 72us (263us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787833866.301040:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64528a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b866019b-748d-45d1-b7c8-b21ed54e15f4+14:3280:x1874679375677952:12345-0@lo:400:kworker.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833866.301050:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787833866.301066:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787833866.301088:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787833866.301093:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3283:x1874679375678080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833866.301100:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375677952:0@lo:400:kworker.0 00000020:00080000:1.0:1787833866.301101:0:5817:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787833866.301156:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3283:x1874679375678080:12345-0@lo:400:kworker.0 Request processed in 62us (279us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787833866.301163:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1787833866.303641:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787833866.303650:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9b647f839800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787833866.303655:0:3283:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787833866.316216:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9b647f839800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787833866.316232:0:3283:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 140 00000100:00080000:0.0:1787833866.316242:0:3283:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b647f839800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787833866.316283:0:3283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b647f93a1c0 x1874679375678336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787833866.316324:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1874679375678080:0@lo:400:kworker.0 00000100:00080000:0.0:1787833866.316404:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787833866.316426:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9b6341339000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787833866.316430:0:3283:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787833866.316433:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9b6341339000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787833866.316436:0:3283:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 162 00000100:00080000:0.0:1787833866.316441:0:3283:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b6341339000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787833866.316455:0:3283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b647f938f00 x1874679375678464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787833866.316465:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64779df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375678208:0@lo:400:kworker.0 00000100:00100000:3.0:1787833866.317008:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1874679375678336:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787833866.317082:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833866.317157:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f938f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1874679375678464:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787833866.317184:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833866.317708:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375678336 00000100:00100000:2.0:1787833866.317718:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375678336 00000100:00100000:2.0:1787833866.317753:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375678464 00000100:00100000:2.0:1787833866.317756:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375678464 00000100:00100000:2.0:1787833866.317798:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787833866.317805:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3279:x1874679375678336:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787833866.317822:0:5816:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787833866.318024:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787833866.318031:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1874679375678464:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787833866.318041:0:5817:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787833866.318102:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1874679375678464:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 69us (916us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787833866.318109:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787833866.318165:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b6341339000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787833866.318170:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787833866.318175:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f938f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1874679375678464:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787833866.331310:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3279:x1874679375678336:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 13496us (14219us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787833866.331326:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1787833866.331799:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b647f839800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833866.331806:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833866.331821:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1874679375678336:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1787833866.556623:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787833867.408218:0:5838:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f29a9da7-4b51-4740-bbc6-5079429f87b0 00000001:00080000:0.0:1787833867.408234:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787833867.408240:0:5838:0:(genops.c:885:class_export_put()) final put ffff9b634133e000/f29a9da7-4b51-4740-bbc6-5079429f87b0 00000020:00000080:0.0:1787833867.408486:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b634133e000/f29a9da7-4b51-4740-bbc6-5079429f87b0 for lustre-MDT0000 00000020:00000080:0.0:1787833867.408539:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b634133b000 for lustre-MDT0000 00000001:00100000:0.0:1787833867.432653:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787833867.432667:0:6686:0:(genops.c:885:class_export_put()) final put ffff9b64451cb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787833867.432756:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64451cb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787833867.432797:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b64451ce000 for lustre-OST0000 00000001:00100000:1.0:1787833867.440269:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787833867.440280:0:7626:0:(genops.c:885:class_export_put()) final put ffff9b6341829800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787833867.441102:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6341829800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787833867.441179:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b634182c800 for lustre-OST0001 00010000:00010000:1.0:1787833867.582331:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833868.604809:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833869.628500:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833870.652844:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787833870.973409:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b646dd8f840 - data ffff9b6470358bd0/ffff9b646e0dec00 00000020:01000000:0.0:1787833870.973576:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b646efa26c0 - data ffff9b645f76d870/ffff9b6445056000 00000001:00000004:0.0:1787833870.979729:0:13048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787833871.084165:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787833871.084174:0:13048:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787833871.084272:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787833871.084275:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787833871.085706:0:6769:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787833871.085713:0:6769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1787833871.085724:0:6769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787833871.086973:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787833871.086989:0:13048:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787833871.087013:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787833871.087016:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787833871.087265:0:8016:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787833871.087271:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787833871.087280:0:8016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787833871.163827:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774a2f 00000020:00000080:3.0:1787833871.163838:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6477aad000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787833871.166510:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6477aad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787833871.167283:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774a44 00000020:00000080:3.0:1787833871.167310:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6477aab000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787833871.167397:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787833871.167404:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833871.167416:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787833871.167420:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9b6477a98000) has no exports 00000004:01000000:3.0:1787833871.167594:0:13048:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787833871.167610:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774c82 00000020:00000080:3.0:1787833871.167615:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6450234000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787833871.168000:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6477aab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787833871.168074:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787833871.168079:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833871.168087:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787833871.168099:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9b6452f2b490) has no exports 00000020:00000080:3.0:1787833871.168106:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774c7b 00000020:00000080:3.0:1787833871.168111:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b647fa62000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787833871.168589:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6450234000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787833871.168597:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b647fa62000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787833871.175298:0:13048:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787833871.175307:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787833871.175312:0:13048:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787833871.175321:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787833871.175323:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787833871.175472:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833871.175485:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787833871.175493:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774b9b 00000020:00000080:3.0:1787833871.175502:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b644507e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787833871.177292:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b647f899800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787833871.177309:0:37:0:(genops.c:885:class_export_put()) final put ffff9b64440ad800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787833871.177313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64440ad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787833871.177328:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787833871.177627:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787833871.177636:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833871.177647:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787833871.177652:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9b6452f28000) has no exports 00000020:00000080:3.0:1787833871.177660:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774b94 00000020:00000080:3.0:1787833871.177666:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b647fa66000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787833871.178018:0:13048:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787833871.178022:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787833871.178026:0:13048:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787833871.178046:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787833871.180603:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787833871.180663:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833871.180934:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787833871.180973:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833871.180977:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787833871.180982:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b64481fb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787833871.180986:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64481fb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787833871.180994:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787833871.181490:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b644507e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787833871.181499:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b647fa66000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787833871.181505:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b647fa67000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787833871.181512:0:37:0:(genops.c:885:class_export_put()) final put ffff9b647fa64800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787833871.181513:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b647fa64800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787833871.181517:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787833871.181658:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774a4b 00000020:00000080:3.0:1787833871.181666:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6477aa8800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787833871.181768:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787833871.181773:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833871.181779:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787833871.181782:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9b6477a99a48) has no exports 00000020:00000080:3.0:1787833871.181802:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833871.181807:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787833871.181811:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774a52 00000020:00000080:3.0:1787833871.181816:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6477aaa000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787833871.182227:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6477aa8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787833871.182233:0:37:0:(genops.c:885:class_export_put()) final put ffff9b6477aa9000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787833871.182235:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6477aa9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787833871.182240:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1787833871.182650:0:13048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6460630000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787833871.182654:0:13048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6460630000 3 00000020:01000004:3.0:1787833871.182657:0:13048:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6460630000 from lustre-MDT0000 00000020:00000080:3.0:1787833871.182689:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833871.182695:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787833871.182698:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6477aaf000/lustre-MDT0000_UUID 00000020:00000080:3.0:1787833871.182700:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6477aaf000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787833871.182707:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787833871.182738:0:13048:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787833871.182743:0:13048:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787833871.182746:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787833871.182749:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833871.182752:0:13048:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787833871.182758:0:13048:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9b64430c5800 b866019b-748d-45d1-b7c8-b21ed54e15f4 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787833871.182774:0:13048:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9b6443e03490) has exports, disconnecting them 00000020:00080000:3.0:1787833871.182778:0:13048:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b64430c5800), last request at 1787833641 00000020:00000080:3.0:1787833871.182793:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e7749f0 00000020:00010000:3.0:1787833871.182798:0:13048:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b64430c5800: total 1 00000100:00080000:3.0:1787833871.182802:0:13048:0:(import.c:65:import_set_state_nolock()) ffff9b64430c2000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787833871.182863:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6477aaa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1787833871.182978:0:13048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b64430c5800): rc 0 00000020:00080000:3.0:1787833871.182983:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9b6443e03490) has no exports 00000100:00100000:3.0:1787833871.183100:0:5810:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b645a77ba00:5810] 2 exiting: rc = 0 00000100:00100000:3.0:1787833871.183184:0:5809:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b6451d99400:5809] 1 exiting: rc = 0 00000100:00100000:0.0:1787833871.185075:0:5807:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b6452377800:5807] 0 exiting: rc = 1 00000020:00010000:2.0:1787833871.185678:0:5804:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b64430c5800: total 0 00010000:00010000:2.0:1787833871.185725:0:5804:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b64430c5800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787833871.185758:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b647751fa00/0x2bdb54ee5e774f37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774f30 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833871.185776:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440030800/0x2bdb54ee5e774d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774d3f expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833871.185788:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c83800/0x2bdb54ee5e774f45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774f3e expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833871.185804:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e774b08 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774b01 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833871.185817:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6440030600/0x2bdb54ee5e774cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774ceb expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833871.185827:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2da00/0x2bdb54ee5e774d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774cf9 expref: 4 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833871.185838:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2d800/0x2bdb54ee5e774d0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774d07 expref: 3 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833871.185867:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e774d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bdb54ee5e774d15 expref: 2 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833871.185879:0:5804:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b64430c5800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787833871.185892:0:5804:0:(genops.c:885:class_export_put()) final put ffff9b64430c5800/b866019b-748d-45d1-b7c8-b21ed54e15f4 00010000:00010000:2.0:1787833871.185907:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833871.185910:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833871.185911:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787833871.185923:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64430c5800/b866019b-748d-45d1-b7c8-b21ed54e15f4 for MGS 00000020:00000080:2.0:1787833871.185959:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b64430c2000 for MGS 00000100:00100000:3.0:1787833871.188831:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188843:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188850:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188856:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188862:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188867:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188873:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188879:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188886:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188892:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188897:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188902:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188908:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188913:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188918:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188923:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188928:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188933:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188938:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188943:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188950:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188955:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188960:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188965:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188990:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.188995:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189001:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189007:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189013:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189019:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189024:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189031:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189037:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189042:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189048:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189067:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189072:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189078:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189083:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189089:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189107:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189114:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189119:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189125:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189130:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189135:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189141:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189146:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189153:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189159:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189165:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189170:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189176:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189181:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189187:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189193:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189198:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189204:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189210:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189223:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189229:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189234:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189239:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.189244:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787833871.190332:0:13048:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787833871.190469:0:13048:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787833871.192025:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6451a8c300 - data ffff9b64793e9ca8/ffff9b6342091800 00000020:01000000:2.0:1787833871.192159:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b644309a360 - data ffff9b645f778000/ffff9b6443e63c00 00000020:00000080:2.0:1787833871.192747:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e7749d4 00000020:00000080:2.0:1787833871.192754:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b64602f8800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787833871.192811:0:13048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6460630000 from MGS, refs=2 00000020:01000004:2.0:1787833871.192816:0:13048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6460630000 2 00000020:01000004:2.0:1787833871.192819:0:13048:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6460630000 from MGS 00000020:00000080:2.0:1787833871.192843:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833871.192850:0:13048:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787833871.192852:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b64602fa800/MGS 00000020:00000080:2.0:1787833871.192855:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64602fa800/MGS for MGS 00000020:01000000:2.0:1787833871.192862:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787833871.192912:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787833871.192916:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833871.192921:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787833871.192928:0:13048:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b64773a6000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787833871.192933:0:13048:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9b6479caced8) has exports, disconnecting them 00000020:00080000:2.0:1787833871.192951:0:13048:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b64773a6000), last request at 1787833642 00000020:00000080:2.0:1787833871.192956:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774a9f 00000020:00080000:2.0:1787833871.192963:0:13048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b64773a6000): rc 0 00000020:00000080:2.0:1787833871.192967:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b64773a6000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787833871.194061:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64602f8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787833871.194453:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64773a6000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787833871.194939:0:13048:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787833871.194945:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787833871.194949:0:13048:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787833871.194956:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787833871.195195:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833871.195202:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787833871.195210:0:13048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6460630000 1 00000020:00000080:2.0:1787833871.195215:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e7749c6 00000020:00000080:2.0:1787833871.195222:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b64602ff000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787833871.195226:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787833871.195231:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833871.195234:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787833871.195237:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9b6443fd8000) has no exports 00000020:00000080:0.0:1787833871.195331:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b64773a2000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787833871.195367:0:38:0:(genops.c:885:class_export_put()) final put ffff9b6468ff6800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787833871.195384:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6468ff6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787833871.195389:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787833871.195443:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64602ff000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787833871.264298:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787833871.264313:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787833871.264318:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6460634000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787833871.264324:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6460634000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787833871.264334:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787833871.264513:0:13048:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b6460637000 00000020:01000000:0.0:1787833871.264538:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787833871.264543:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787833871.264548:0:13048:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787833871.264552:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9b6443fd9a48) has no exports 00000100:00100000:0.0:1787833871.264638:0:7195:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b646fd8d000:7195] 3 exiting: rc = 0 00000100:00100000:0.0:1787833871.264756:0:5815:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b645295aa00:5815] 0 exiting: rc = 1 00000100:00100000:1.0:1787833871.267294:0:5817:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b6468d8d600:5817] 2 exiting: rc = 0 00000100:00100000:2.0:1787833871.267743:0:5816:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b645295be00:5816] 1 exiting: rc = 0 00000100:00100000:0.0:1787833871.267964:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.267973:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.267979:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.267995:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268001:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268007:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268013:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268018:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268023:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268029:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268035:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268040:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268045:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268063:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268069:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268073:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268078:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268103:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268109:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268115:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268120:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268126:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268131:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268137:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268142:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268147:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268152:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268158:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268163:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268168:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268173:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268178:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268182:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268187:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268193:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268197:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268202:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268207:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268212:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268217:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268222:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268227:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268232:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268237:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268243:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268248:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268254:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268259:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268264:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268269:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268275:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268280:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268292:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268297:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268303:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268309:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268314:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268319:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268324:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268330:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268335:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268367:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268373:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.268385:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.274533:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b6468d8ce00:5819] 1 exiting: rc = 0 00000100:00100000:1.0:1787833871.275007:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b6468d8d400:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1787833871.275589:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275598:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275605:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275611:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275617:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275622:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275629:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275634:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275640:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275645:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275650:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275656:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275664:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275678:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275684:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275689:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275694:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275699:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275704:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275710:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275715:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275720:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275726:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275744:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275748:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275754:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275760:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275765:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275771:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275776:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275782:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275786:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275791:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275796:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275801:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275805:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275809:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275814:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275818:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275823:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275828:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275832:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275837:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275841:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275845:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275850:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275855:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275860:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275864:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275869:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275874:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275878:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275882:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275887:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275891:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275896:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275901:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275905:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275918:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275923:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275928:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275932:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275937:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.275941:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.276564:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b6451d98200:5821] 1 exiting: rc = 0 00000100:00100000:1.0:1787833871.276912:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b6451d99600:5820] 0 exiting: rc = 1 00000100:00100000:3.0:1787833871.278596:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278607:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278613:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278619:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278625:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278631:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278638:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278645:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278652:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278687:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278694:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278699:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278706:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278712:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278717:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278723:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278727:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278733:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278738:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278744:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278751:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278770:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278777:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278782:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278789:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278797:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278804:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278810:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278816:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278841:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278847:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278853:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278859:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278880:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278888:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278895:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278901:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278906:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278912:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278918:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278924:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278930:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278936:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278941:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278948:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278968:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278975:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278981:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278986:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278993:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.278999:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279005:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279012:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279018:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279024:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279029:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279035:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279067:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279074:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279081:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279086:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279102:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279108:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.279115:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.295267:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b6451d99a00:5822] 0 exiting: rc = 1 00000100:00100000:3.0:1787833871.297437:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b6451d99800:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1787833871.297555:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297563:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297568:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297573:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297579:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297584:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297589:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297596:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297601:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297606:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297612:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297617:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297621:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297626:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297631:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297636:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297642:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297647:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297653:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297658:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297663:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297668:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297680:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297686:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297691:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297695:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297700:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297705:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297709:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297713:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297717:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297721:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297725:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297729:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297754:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297758:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297764:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297768:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297773:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297778:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297783:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297788:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297793:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297799:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297803:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297808:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297813:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297817:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297821:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297826:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297831:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297836:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297841:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297846:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297852:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297857:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297862:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297867:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297873:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297878:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297883:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297888:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297893:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.297897:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298308:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b6451d98e00:5825] 1 exiting: rc = 0 00000100:00100000:0.0:1787833871.298518:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b6451d98800:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1787833871.298883:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298890:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298895:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298900:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298916:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298920:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298925:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298931:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298937:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298943:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298948:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298953:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298958:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298963:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298968:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298973:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298978:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298983:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298989:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298994:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.298999:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299004:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299009:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299014:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299019:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299023:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299028:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299033:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299038:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299043:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299058:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299064:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299069:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299074:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299079:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299084:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299088:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299104:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299110:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299122:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299128:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299132:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299137:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299141:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299145:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299150:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299155:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299160:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299165:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299169:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299175:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299181:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299187:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299192:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299197:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299202:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299207:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299212:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299217:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299222:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299227:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299231:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299236:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299241:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.299632:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b6452958800:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1787833871.299829:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b6451d98000:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1787833871.301311:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301321:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301326:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301331:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301336:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301397:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301403:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301408:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301413:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301437:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301442:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301447:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301452:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301457:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301463:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301468:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301473:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301477:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301482:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301487:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301491:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301495:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301500:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301505:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301510:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301516:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301521:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301525:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301530:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301535:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301539:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301543:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301548:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301552:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301557:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301561:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301566:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301571:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301575:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301579:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301584:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301588:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301593:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301597:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301610:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301615:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301619:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301624:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301628:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301633:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301638:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301643:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301648:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301653:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301658:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.301663:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.302082:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.302102:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.302107:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.302112:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.302117:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.302122:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.302126:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.302131:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787833871.302847:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b6452942c00:5830] 2 exiting: rc = 0 00000100:00100000:0.0:1787833871.305031:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b644693c600:5828] 0 exiting: rc = 1 00000100:00100000:3.0:1787833871.305905:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b6445db5a00:5829] 1 exiting: rc = 0 00000100:00100000:0.0:1787833871.306728:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306736:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306743:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306749:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306754:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306760:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306765:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306769:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306774:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306779:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306785:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306790:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306795:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306800:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306805:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306810:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306815:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306821:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306841:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306848:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306854:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306859:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306865:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306883:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306889:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306894:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306900:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306907:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306912:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306918:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306924:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306929:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306935:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306941:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306947:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306953:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306958:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306963:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306969:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306975:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306979:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.306984:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.307004:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.307011:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.307016:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.307022:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.307027:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.307032:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.307037:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.307043:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308379:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308397:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308403:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308409:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308414:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308420:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308425:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308431:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308453:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308459:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308464:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308469:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308474:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833871.308491:0:13048:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787833871.320826:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787833871.320849:0:13048:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787833871.320855:0:13048:0:(genops.c:885:class_export_put()) final put ffff9b6452952000/MDS_uuid 00000020:00000080:3.0:1787833871.320862:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6452952000/MDS_uuid for MDS 00000020:01000000:3.0:1787833871.320875:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787833871.321225:0:13048:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:3.0:1787833871.427704:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787833871.427713:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787833871.427717:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b647f839800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787833871.427727:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 345 00000100:00080000:3.0:1787833871.427733:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787833871.427749:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b647f839800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787833871.427777:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b64623ea1c0 x1874679375678720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787833871.427795:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787833871.427799:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787833871.427801:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b6341339000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787833871.427804:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 345 00000100:00080000:3.0:1787833871.427806:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787833871.427809:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b6341339000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787833871.427820:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b64623ebc00 x1874679375678848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833871.427842:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787833871.427860:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375678592:0@lo:400:kworker.0 00000400:00000100:3.0:1787833871.427920:0:3281:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874679375678592 offset 0 length 224: 4 00000100:00100000:3.0:1787833871.427975:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1874679375678720:0@lo:38:kworker.0 00000400:00000100:3.0:1787833871.427997:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679375678720 offset 0 length 520: 4 00000100:00100000:3.0:1787833871.428010:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1874679375678848:0@lo:38:kworker.0 00000400:00000100:3.0:1787833871.428024:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874679375678848 offset 0 length 520: 4 00010000:00010000:1.0:1787833871.676567:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833872.701561:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833873.725049:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787833874.196961:0:13203:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787833874.217811:0:13203:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787833874.217860:0:13203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833874.217875:0:13203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833874.217883:0:13203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833874.217889:0:13203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833874.217915:0:13203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787833874.217922:0:13203:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787833874.217941:0:13203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787833874.217953:0:13203:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b64623ea1c0 x1874679375678720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787833886 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833874.217969:0:13203:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787833874.217975:0:13203:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787833874.217981:0:13203:0:(import.c:65:import_set_state_nolock()) ffff9b647f839800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787833874.217986:0:13203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787833874.217990:0:13203:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b64623ea1c0 x1874679375678720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787833886 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833874.218011:0:13203:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787833874.218015:0:13203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:1.0:1787833874.218074:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833874.218081:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833874.218089:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2dc00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833874.218093:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833874.218103:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833874.218109:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833874.218113:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787833874.218114:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787833874.218116:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787833874.218150:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833874.218155:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833874.218185:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833874.218190:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2dc00/0x2bdb54ee5e774d07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d0e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833874.218197:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833874.218198:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833874.218199:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833874.218373:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833874.218389:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375678976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833874.218444:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833874.218640:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375678976 00000100:00100000:1.0:1787833874.218652:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375678976 00000100:00100000:1.0:1787833874.218697:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787833874.218705:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3280:x1874679375678976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787833874.218711:0:5800:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787833874 with bad export cookie 3160212946294360560 00000100:00100000:3.0:1787833874.220250:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1874679375678720:0@lo:38:kworker.0 00010000:00010000:2.0:1787833874.221898:0:13203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833874.221916:0:13203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833874.221924:0:13203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833874.221949:0:13203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833874.221972:0:13203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833874.221979:0:13203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833874.221983:0:13203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833874.221987:0:13203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833874.221990:0:13203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833874.221997:0:13203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787833874.221999:0:13203:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787833874.222019:0:13203:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787833874.222023:0:13203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787833874.222027:0:13203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833874.222032:0:13203:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787833874.222036:0:13203:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b6479cab490) has no exports 00000020:00080000:2.0:1787833874.222062:0:13203:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b6479cab490) has no exports 00000020:01000000:2.0:1787833874.223619:0:13203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b647f9269c0 - data ffff9b64792ece58/ffff9b646e195800 00000020:01000000:2.0:1787833874.223782:0:13203:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6450f24000 - data ffff9b64702eb288/ffff9b6341107000 00010000:00010000:3.0:1787833874.224058:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833874.224078:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224105:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6440030000 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:3.0:1787833874.224108:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224116:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833874.224120:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833874.224124:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787833874.224126:0:6674:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787833874.224128:0:6674:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787833874.224163:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224167:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833874.224189:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224194:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6440030000/0x2bdb54ee5e774d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774d1c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224202:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833874.224204:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224208:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d400 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:3.0:1787833874.224210:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224219:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833874.224222:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833874.224225:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787833874.224226:0:6674:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787833874.224227:0:6674:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787833874.224235:0:6674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224238:0:6674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833874.224241:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224245:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e774f3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bdb54ee5e774f45 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833874.224250:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833874.224251:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833874.224253:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833874.224258:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833874.224272:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375679104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833874.224333:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833874.224401:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833874.224405:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375679232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833874.224422:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833874.225411:0:13049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375679104 00000100:00100000:3.0:1787833874.225431:0:13049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375679104 00000100:00100000:3.0:1787833874.225468:0:13049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375679232 00000100:00100000:3.0:1787833874.225472:0:13049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375679232 00000100:00100000:3.0:1787833874.225486:0:13049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787833874.225494:0:13049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3282:x1874679375679104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787833874.225500:0:13049:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787833874 with bad export cookie 3160212946294360560 00000100:00100000:3.0:1787833874.225559:0:13049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3282:x1874679375679104:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (1225us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787833874.225566:0:13049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787833874.225583:0:13049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787833874.225587:0:13049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3282:x1874679375679232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787833874.225591:0:13049:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787833874 with bad export cookie 3160212946294360560 00000100:00100000:3.0:1787833874.225616:0:13049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3282:x1874679375679232:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (1192us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787833874.225622:0:13049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787833874.225659:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787833874.225664:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b6452953000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787833874.225668:0:3282:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.115@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787833874.235682:0:3282:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.115@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787833874.235687:0:3282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787833874.235697:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b64623e9680 x1874679375678592/t0(0) o400->MGC192.168.202.115@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787833887 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833874.235776:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6477406940 x1874679375678976/t0(0) o103->MGC192.168.202.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787833890 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833874.235794:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b64623ea1c0 x1874679375679104/t0(0) o103->MGC192.168.202.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787833890 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833874.235803:0:3282:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b64623ead00 x1874679375679232/t0(0) o103->MGC192.168.202.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787833890 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787833874.235830:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787833874.235833:0:3282:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787833874.235834:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787833874.235838:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b6452953000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787833874.235843:0:3282:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 120 00000100:00080000:3.0:1787833874.235852:0:3282:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import ffff9b6452953000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787833874.235881:0:3282:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b64623e9e00 x1874679375679360/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833874.235913:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b866019b-748d-45d1-b7c8-b21ed54e15f4:3279:1874679375679360:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1787833874.235963:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874679375679360 offset 0 length 520: 4 00000100:00100000:3.0:1787833874.236039:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375679104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833874.236059:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b866019b-748d-45d1-b7c8-b21ed54e15f4:3282:1874679375679232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833874.236144:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b866019b-748d-45d1-b7c8-b21ed54e15f4:3280:1874679375678976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787833874.236239:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b866019b-748d-45d1-b7c8-b21ed54e15f4:3281:1874679375678592:0@lo:400:kworker.0 00000400:00000100:1.0:1787833874.241891:0:5800:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874679375678976 offset 224 length 224: 4 00000100:00100000:1.0:1787833874.241913:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3280:x1874679375678976:12345-0@lo:103:ldlm_bl.0 Request processed in 23208us (23467us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787833874.241923:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00100000:10000000:2.0:1787833874.256086:0:13203:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787833874.281162:0:13203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774b24 00000020:00000080:2.0:1787833874.281172:0:13203:0:(genops.c:885:class_export_put()) final put ffff9b6452956000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787833874.281223:0:13203:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b64773a1800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787833874.281228:0:13203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b64773a1800 2 00000020:01000004:2.0:1787833874.281231:0:13203:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b64773a1800 from lustre-OST0000 00000020:00000080:2.0:1787833874.281255:0:13203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833874.281266:0:13203:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787833874.281269:0:13203:0:(genops.c:885:class_export_put()) final put ffff9b64451ca800/lustre-OST0000_UUID 00000020:00000080:2.0:1787833874.281271:0:13203:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64451ca800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787833874.281278:0:13203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787833874.281320:0:13203:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787833874.281357:0:13203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787833874.281361:0:13203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833874.281365:0:13203:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787833874.281371:0:13203:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b6452955800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787833874.281376:0:13203:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9b6443fdb490) has exports, disconnecting them 00000020:00080000:2.0:1787833874.281379:0:13203:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b6452955800), last request at 1787833661 00000020:00000080:2.0:1787833874.281383:0:13203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774b4e 00000020:00080000:2.0:1787833874.281392:0:13203:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6452955800): rc 0 00000020:00000080:2.0:1787833874.281396:0:13203:0:(genops.c:885:class_export_put()) final put ffff9b6452955800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787833874.281775:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6452956000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787833874.282881:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6452955800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787833874.285511:0:13203:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787833874.285520:0:13203:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787833874.285525:0:13203:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787833874.285531:0:13203:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787833874.285566:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b647f839800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787833874.285747:0:13203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787833874.285762:0:13203:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787833874.285769:0:13203:0:(genops.c:885:class_export_put()) final put ffff9b647f83d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787833874.285772:0:13203:0:(genops.c:844:class_export_destroy()) destroying export ffff9b647f83d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787833874.285781:0:13203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787833874.285840:0:13203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b64773a1800 1 00000020:00000080:1.0:1787833874.285846:0:13203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774ade 00000020:00000080:1.0:1787833874.285851:0:13203:0:(genops.c:885:class_export_put()) final put ffff9b64440af000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787833874.285860:0:13203:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787833874.285868:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64440af000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787833874.285877:0:13203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787833874.285881:0:13203:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787833874.285885:0:13203:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9b6479ca9a48) has no exports 00000020:00000080:1.0:1787833874.308367:0:13203:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787833874.308392:0:13203:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787833874.308397:0:13203:0:(genops.c:885:class_export_put()) final put ffff9b64773a5000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787833874.308401:0:13203:0:(genops.c:844:class_export_destroy()) destroying export ffff9b64773a5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787833874.308407:0:13203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787833874.308535:0:13203:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b64773a3000 00000020:02000400:1.0:1787833874.308587:0:13203:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787833874.752897:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833875.777803:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787833876.541589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b866019b-748d-45d1-b7c8-b21ed54e15f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787833876.541605:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b866019b-748d-45d1-b7c8-b21ed54e15f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787833876.541610:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787833876.541613:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787833876.797739:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787833877.497716:0:13353:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787833877.520814:0:13353:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787833877.520906:0:13353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.520923:0:13353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.520930:0:13353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.520938:0:13353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.521007:0:13353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787833877.521025:0:13353:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787833877.521061:0:13353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787833877.521076:0:13353:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b64623ebc00 x1874679375678848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787833886 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833877.521106:0:13353:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787833877.521112:0:13353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787833877.521120:0:13353:0:(import.c:65:import_set_state_nolock()) ffff9b6341339000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787833877.521124:0:13353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787833877.521128:0:13353:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b64623ebc00 x1874679375678848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787833886 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833877.521134:0:13353:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787833877.521137:0:13353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:2.0:1787833877.524165:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1874679375678848:0@lo:38:kworker.0 00010000:00010000:3.0:1787833877.525858:0:13353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.525879:0:13353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.525886:0:13353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.525893:0:13353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.528236:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787833877.528251:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.528262:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83200 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833877.528268:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.528279:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833877.528287:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833877.528293:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787833877.528296:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787833877.528300:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787833877.528316:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6452953000 00010000:00010000:0.0:1787833877.528321:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.528377:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c83200/0x2bdb54ee5e774ceb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bdb54ee5e774cf2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.529169:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833877.529174:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.529180:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82800 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833877.529184:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.529192:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833877.529199:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833877.529204:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787833877.529207:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1787833877.529214:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6452953000 00010000:00010000:0.0:1787833877.529218:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.529226:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833877.529227:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833877.529230:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833877.529593:0:13353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787833877.529602:0:13353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c82800/0x2bdb54ee5e774cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bdb54ee5e774d00 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.529701:0:13353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.529723:0:13353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.529730:0:13353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.529737:0:13353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833877.529751:0:13353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787833877.529755:0:13353:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1787833877.529759:0:13353:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787833877.529790:0:13353:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787833877.529794:0:13353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787833877.529799:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787833877.529805:0:13353:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787833877.529809:0:13353:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b6341b6ced8) has no exports 00000020:00080000:3.0:1787833877.529836:0:13353:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b6341b6ced8) has no exports 00010000:00010000:1.0:1787833877.530850:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833877.530861:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.530872:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199e00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833877.530875:0:6674:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.530884:0:6674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833877.530891:0:6674:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833877.530896:0:6674:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787833877.530899:0:6674:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787833877.530901:0:6674:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787833877.530912:0:6674:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6452953000 00010000:00010000:1.0:1787833877.530915:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.530922:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e774f30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bdb54ee5e774f37 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833877.531827:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833877.531908:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833877.531910:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833877.531912:0:6674:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787833877.536278:0:13353:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b647f926780 - data ffff9b64792ecbd0/ffff9b646e197c00 00000020:01000000:0.0:1787833877.536663:0:13353:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b6477708120 - data ffff9b6479266798/ffff9b6342111c00 00100000:10000000:1.0:1787833877.562771:0:13353:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787833877.622492:0:13353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774bef 00000020:00000080:1.0:1787833877.622505:0:13353:0:(genops.c:885:class_export_put()) final put ffff9b634182a800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787833877.622561:0:13353:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b647fa63000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787833877.622565:0:13353:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b647fa63000 2 00000020:01000004:1.0:1787833877.622568:0:13353:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b647fa63000 from lustre-OST0001 00000020:00000080:1.0:1787833877.622598:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787833877.622611:0:13353:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787833877.622614:0:13353:0:(genops.c:885:class_export_put()) final put ffff9b634182a000/lustre-OST0001_UUID 00000020:00000080:1.0:1787833877.622617:0:13353:0:(genops.c:844:class_export_destroy()) destroying export ffff9b634182a000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787833877.622625:0:13353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787833877.622757:0:13353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b866019b-748d-45d1-b7c8-b21ed54e15f4->MGS 00010000:00010000:1.0:1787833877.622773:0:13353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774b08 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833877.622785:0:13353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774b08 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833877.622792:0:13353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787833877.622795:0:13353:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787833877.622798:0:13353:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787833877.622813:0:13353:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6452953000 00010000:00010000:1.0:1787833877.622816:0:13353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6476c83a00/0x2bdb54ee5e774b01 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bdb54ee5e774b08 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833877.622855:0:13353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bdb54ee5e774d46 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833877.622873:0:13353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bdb54ee5e774d46 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833877.622878:0:13353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787833877.622881:0:13353:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787833877.622882:0:13353:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787833877.622892:0:13353:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6452953000 00010000:00010000:1.0:1787833877.622895:0:13353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6440031c00/0x2bdb54ee5e774d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bdb54ee5e774d46 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787833877.622912:0:13353:0:(import.c:65:import_set_state_nolock()) ffff9b6452953000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787833877.622916:0:13353:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787833877.622918:0:13353:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787833877.622920:0:13353:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787833877.622924:0:13353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787833877.622934:0:13353:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b64623e9e00 x1874679375679360/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787833884 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787833877.622960:0:13353:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787833877.622962:0:13353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1787833877.623083:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b866019b-748d-45d1-b7c8-b21ed54e15f4:3279:1874679375679360:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:1.0:1787833877.625268:0:13353:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787833877.625288:0:13353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e7749e2 00000020:00000080:1.0:1787833877.625298:0:13353:0:(genops.c:885:class_export_put()) final put ffff9b6452950800/b866019b-748d-45d1-b7c8-b21ed54e15f4 00000020:00000080:2.0:1787833877.626901:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b634182a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787833877.627156:0:13353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.115@tcp (flags='') 00000020:00000080:1.0:1787833877.627172:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787833877.627182:0:13353:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.115@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787833877.627186:0:13353:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9b6443fdced8) has no exports 00000020:00000080:0.0:1787833877.627249:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6452950800/b866019b-748d-45d1-b7c8-b21ed54e15f4 for MGC192.168.202.115@tcp 10000000:01000000:2.0:1787833877.627364:0:5812:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787833877.627551:0:13353:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.115@tcp: client import never connected 00000100:00080000:1.0:1787833877.627556:0:13353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787833877.627574:0:13353:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787833877.627626:0:13353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787833877.627642:0:13353:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787833877.627690:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787833877.627697:0:13353:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.115@tcp (uuid b866019b-748d-45d1-b7c8-b21ed54e15f4) 00000020:00000080:0.0:1787833877.627729:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6452953000 for MGC192.168.202.115@tcp 00000020:00000080:0.0:1787833877.627737:0:37:0:(genops.c:885:class_export_put()) final put ffff9b6452951800/b866019b-748d-45d1-b7c8-b21ed54e15f4 00000020:00000080:0.0:1787833877.627740:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6452951800/b866019b-748d-45d1-b7c8-b21ed54e15f4 for MGC192.168.202.115@tcp 00000020:01000000:0.0:1787833877.627744:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.115@tcp (b866019b-748d-45d1-b7c8-b21ed54e15f4) 00000020:01000000:1.0:1787833877.628115:0:13353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787833877.628121:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787833877.628126:0:13353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787833877.628134:0:13353:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b634133c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787833877.628139:0:13353:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9b6452f29a48) has exports, disconnecting them 00000020:00080000:1.0:1787833877.628145:0:13353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b634133c800), last request at 1787833683 00000020:00000080:1.0:1787833877.628150:0:13353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774c19 00000020:00080000:1.0:1787833877.628175:0:13353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b634133c800): rc 0 00000020:00000080:1.0:1787833877.628179:0:13353:0:(genops.c:885:class_export_put()) final put ffff9b634133c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787833877.629206:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b634133c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787833877.632419:0:13353:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787833877.632429:0:13353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787833877.632434:0:13353:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787833877.632440:0:13353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787833877.632472:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b6341339000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787833877.632517:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787833877.632633:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787833877.632678:0:6674:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787833877.633140:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b64430ff200:5799] 1 exiting: rc = 0 00000100:00100000:2.0:1787833877.635178:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b64430ffa00:5798] 0 exiting: rc = 1 00000100:00100000:0.0:1787833877.635993:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.636284:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b6450f8b800:5801] 1 exiting: rc = 0 00000100:00100000:2.0:1787833877.636402:0:13049:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b647fa9dc00:13049] 3 exiting: rc = 0 00000100:00100000:2.0:1787833877.637629:0:5802:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b6450f8a200:5802] 2 exiting: rc = 0 00000100:00100000:0.0:1787833877.640676:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b6450f8b000:5800] 0 exiting: rc = 1 00000100:00100000:2.0:1787833877.641004:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641028:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641046:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641053:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641059:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641064:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641071:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641077:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641082:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641099:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641107:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641114:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641119:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641125:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641132:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641138:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641145:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641151:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641156:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641163:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641170:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641176:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641182:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641187:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641192:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641198:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641204:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641210:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641215:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641221:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641226:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641233:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641238:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641244:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641249:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641255:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641268:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641274:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641279:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641285:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641291:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641297:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641302:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641308:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641314:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641319:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641323:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641328:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641334:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641361:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641367:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641373:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641379:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641384:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641390:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641395:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641399:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641404:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641410:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641415:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641420:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641426:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641446:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.641452:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787833877.642327:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833877.642356:0:13353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787833877.642364:0:13353:0:(genops.c:885:class_export_put()) final put ffff9b647fa67800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787833877.642369:0:13353:0:(genops.c:844:class_export_destroy()) destroying export ffff9b647fa67800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787833877.642375:0:13353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787833877.642416:0:13353:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b647fa63000 1 00000020:00000080:2.0:1787833877.642535:0:13353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bdb54ee5e774bbe 00000020:00000080:2.0:1787833877.642542:0:13353:0:(genops.c:885:class_export_put()) final put ffff9b6450230000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787833877.642561:0:13353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787833877.642566:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833877.642571:0:13353:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787833877.642575:0:13353:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9b6452f2ced8) has no exports 00000020:00000080:0.0:1787833877.642944:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6450230000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787833877.667019:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833877.667047:0:13353:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787833877.667056:0:13353:0:(genops.c:885:class_export_put()) final put ffff9b647fa64000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787833877.667060:0:13353:0:(genops.c:844:class_export_destroy()) destroying export ffff9b647fa64000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787833877.667068:0:13353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787833877.667301:0:13353:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b647fa65000 00000020:01000000:2.0:1787833877.667329:0:13353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787833877.667333:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787833877.667364:0:13353:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787833877.667368:0:13353:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9b6443e00000) has no exports 00000020:00000080:2.0:1787833877.667407:0:13353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787833877.667413:0:13353:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787833877.667416:0:13353:0:(genops.c:885:class_export_put()) final put ffff9b6445086000/OSS_uuid 00000020:00000080:2.0:1787833877.667418:0:13353:0:(genops.c:844:class_export_destroy()) destroying export ffff9b6445086000/OSS_uuid for OSS 00000020:01000000:2.0:1787833877.667422:0:13353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787833877.667704:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b64770e2a00:6659] 0 exiting: rc = 1 00000100:00100000:2.0:1787833877.672295:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b64770e2800:6660] 1 exiting: rc = 0 00000100:00100000:1.0:1787833877.673999:0:8382:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b64503b3e00:8382] 3 exiting: rc = 0 00000100:00080000:0.0:1787833877.675398:0:5811:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787833877.675578:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b64770e3000:6661] 2 exiting: rc = 0 00000100:00100000:0.0:1787833877.676598:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676608:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676614:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676621:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676627:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676632:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676637:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676643:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676648:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676669:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676674:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676680:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676685:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676690:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676695:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676699:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676705:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676710:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676715:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676720:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676726:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676730:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.676736:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678892:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678909:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678915:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678920:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678925:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678931:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678936:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678942:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678947:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678954:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678958:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678973:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678977:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678985:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.678999:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679005:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679012:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679022:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679028:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679042:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679048:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679069:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679074:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679079:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679094:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679102:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679107:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679112:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679118:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679123:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679128:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679133:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679140:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679145:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679150:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679156:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679161:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679165:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679171:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679176:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.679181:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.680966:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b6479de4400:6662] 0 exiting: rc = 1 00000100:00100000:2.0:1787833877.681072:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b6479de4000:6663] 1 exiting: rc = 0 00000100:00100000:0.0:1787833877.681928:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.681938:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.681945:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.681951:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.681959:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.681966:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.681975:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.681985:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682071:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682079:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682084:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682097:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682102:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682111:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682116:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682134:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682138:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682142:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682148:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682153:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682158:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682164:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682170:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682174:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682179:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682184:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682189:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682194:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682198:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682203:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682207:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682212:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682216:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682221:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682226:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682231:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682237:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682242:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682248:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682253:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682258:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682263:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682268:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682274:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682279:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682284:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682290:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682296:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682302:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682307:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682321:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682327:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682333:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682357:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682364:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682369:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682374:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682389:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682395:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682400:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682405:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682416:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682421:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.682435:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.683564:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b64770e2200:6666] 2 exiting: rc = 0 00000100:00100000:2.0:1787833877.684363:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b6443170a00:6664] 0 exiting: rc = 1 00000100:00100000:3.0:1787833877.691097:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b647799ec00:6665] 1 exiting: rc = 0 00000100:00100000:2.0:1787833877.691239:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691251:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691258:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691265:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691270:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691288:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691293:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691298:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691304:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691309:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691316:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691333:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691360:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691366:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691371:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691380:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691385:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691390:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691396:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691402:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691486:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691495:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691502:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691509:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691515:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691521:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691528:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691534:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691540:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691548:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691553:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691558:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691564:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691571:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691576:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691596:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691604:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691613:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691619:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691624:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691636:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691641:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691648:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691656:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691661:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691667:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691673:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691679:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691685:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691691:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691697:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691703:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691710:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691717:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691723:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691728:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691734:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691740:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691746:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691751:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691757:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691763:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691769:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.691776:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.697486:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b64773dbe00:6667] 0 exiting: rc = 1 00000100:00100000:1.0:1787833877.697519:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b647728dc00:6668] 1 exiting: rc = 0 00000100:00100000:2.0:1787833877.697692:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697700:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697706:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697712:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697719:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697724:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697730:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697736:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697741:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697746:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697752:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697770:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697776:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697782:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697788:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697794:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697800:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697806:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697812:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697960:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697969:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697975:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697980:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697985:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697989:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697994:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.697998:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698003:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698010:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698014:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698022:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698027:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698040:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698050:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698059:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698065:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698070:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698078:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698083:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698090:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698095:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698100:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698105:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698110:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698116:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698121:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698136:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698141:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698146:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698160:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698166:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698171:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698177:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698185:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698191:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698196:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698201:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698208:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698214:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698219:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698224:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698228:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698233:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.698238:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787833877.699141:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b64773da600:6669] 0 exiting: rc = 1 00000100:00100000:1.0:1787833877.700042:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b647728c400:6670] 1 exiting: rc = 0 00000100:00100000:2.0:1787833877.700265:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700284:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700292:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700298:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700305:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700310:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700329:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700337:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700375:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700381:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700387:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700697:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700707:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700713:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700719:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700725:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700731:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700750:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700768:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700775:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700781:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700787:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700794:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700800:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700807:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700813:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700832:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700845:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700852:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700859:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700881:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700896:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700907:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700914:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700919:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700926:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700931:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700938:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700944:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700949:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700955:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700961:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700986:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.700993:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701000:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701009:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701015:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701020:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701026:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701041:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701049:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701054:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701068:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701074:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701096:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701103:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701108:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701114:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701121:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701126:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701131:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701138:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701145:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787833877.701160:0:13353:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787833877.720456:0:13353:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787833894.693335:0:13965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787833902.752011:0:14426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787833902.752019:0:14426:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787833902.752128:0:14426:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b6477609800 00000020:01000004:2.0:1787833902.752146:0:14426:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787833902.752154:0:14426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787833902.752168:0:14426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b6443e00000) 00000020:00000080:2.0:1787833902.752181:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787833902.768082:0:14426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787833902.770385:0:14426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787833902.770737:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 549: rc = 0 00100000:10000000:2.0:1787833902.771031:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 549: rc = 0 00100000:10000000:2.0:1787833902.771104:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 549: rc = 0 00100000:10000000:2.0:1787833902.771178:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 549: rc = 0 00100000:10000000:2.0:1787833902.771268:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 549: rc = 0 00100000:10000000:2.0:1787833902.771554:0:14426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787833902.771601:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 549: rc = 0 00100000:10000000:2.0:1787833902.771922:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 551: rc = 0 00100000:10000000:2.0:1787833902.773140:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 687: rc = 0 00100000:10000000:2.0:1787833902.773272:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 687: rc = 0 00100000:10000000:2.0:1787833902.773894:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1787833902.774096:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1787833902.774427:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1787833902.775212:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 768: rc = 0 00100000:10000000:2.0:1787833902.775599:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1787833902.775821:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1787833902.776041:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1787833902.776216:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 768: rc = 0 00100000:10000000:2.0:1787833902.776721:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1787833902.776979:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 768: rc = 0 00100000:10000000:2.0:1787833902.777161:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1787833902.777494:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 768: rc = 0 00100000:10000000:2.0:1787833902.777917:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 21: rc = 0 00100000:10000000:2.0:1787833902.778303:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 21: rc = 0 00100000:10000000:2.0:1787833902.778553:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 21: rc = 0 00100000:10000000:2.0:1787833902.778824:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 21: rc = 0 00100000:10000000:2.0:1787833902.779036:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 21: rc = 0 00100000:10000000:2.0:1787833902.779283:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 21: rc = 0 00100000:10000000:2.0:1787833902.779695:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 21: rc = 0 00100000:10000000:2.0:1787833902.779968:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 21: rc = 0 00100000:10000000:2.0:1787833902.780478:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 21: rc = 0 00100000:10000000:2.0:1787833902.780718:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 21: rc = 0 00100000:10000000:2.0:1787833902.780956:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 21: rc = 0 00100000:10000000:2.0:1787833902.781152:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 21: rc = 0 00100000:10000000:2.0:1787833902.781566:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 21: rc = 0 00100000:10000000:2.0:1787833902.781960:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 21: rc = 0 00100000:10000000:2.0:1787833902.782156:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 21: rc = 0 00100000:10000000:2.0:1787833902.782370:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 21: rc = 0 00100000:10000000:2.0:1787833902.782548:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 21: rc = 0 00100000:10000000:2.0:1787833902.782746:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 21: rc = 0 00100000:10000000:2.0:1787833902.782978:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 21: rc = 0 00100000:10000000:2.0:1787833902.783149:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 21: rc = 0 00100000:10000000:2.0:1787833902.783330:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 21: rc = 0 00100000:10000000:2.0:1787833902.783590:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 21: rc = 0 00100000:10000000:2.0:1787833902.783802:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 21: rc = 0 00100000:10000000:2.0:1787833902.784057:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 21: rc = 0 00100000:10000000:2.0:1787833902.784247:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 21: rc = 0 00100000:10000000:2.0:1787833902.786060:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 21: rc = 0 00100000:10000000:2.0:1787833902.788121:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 21: rc = 0 00100000:10000000:2.0:1787833902.788790:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 21: rc = 0 00100000:10000000:2.0:1787833902.789081:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 21: rc = 0 00100000:10000000:2.0:1787833902.789924:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 21: rc = 0 00100000:10000000:2.0:1787833902.790174:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 21: rc = 0 00100000:10000000:2.0:1787833902.791543:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 21: rc = 0 00100000:10000000:2.0:1787833902.791930:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 16: rc = 0 00100000:10000000:2.0:1787833902.792441:0:14426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787833902.792609:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 691: rc = 0 00100000:10000000:2.0:1787833902.792803:0:14426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787833902.798058:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 691: rc = 0 00100000:10000000:0.0:1787833902.799017:0:14426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1787833902.799117:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 691: rc = 0 00100000:10000000:0.0:1787833902.800739:0:14426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787833902.801499:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 688: rc = 0 00100000:10000000:0.0:1787833902.802012:0:14426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787833902.802087:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 688: rc = 0 00100000:10000000:0.0:1787833902.802274:0:14426:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787833902.803472:0:14426:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 688: rc = 0 00000020:00000080:0.0:1787833902.804691:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787833902.804700:0:14426:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787833902.804710:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e775ce3 00000020:01000004:0.0:1787833902.804910:0:14426:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787833902.804917:0:14426:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787833902.804939:0:14426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6477609800 from MGS 00000020:01000004:0.0:1787833902.804943:0:14426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787833902.804955:0:14426:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b6479caced8) 00000020:00000080:0.0:1787833902.804966:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787833902.805029:0:14426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6477609800 from MGS, refs=2 00080000:01000000:0.0:1787833902.805033:0:14426:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787833902.805039:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e775cf1 00000100:00100000:0.0:1787833902.805196:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787833902.805587:0:14426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787833902.805593:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787833902.806481:0:14426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787833902.806488:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787833902.807257:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833902.811638:0:14426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787833902.811655:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787833902.812144:0:14426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787833902.812149:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787833902.812632:0:14426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787833902.812638:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787833902.817021:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833902.817027:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833902.817029:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833902.817399:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833902.817402:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833902.817404:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833902.818630:0:14426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787833902.823542:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787833902.837711:0:14426:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787833902.837731:0:14426:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787833902.837733:0:14426:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787833902.844039:0:14435:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787833902.844314:0:14426:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787833902.844582:0:14426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787833902.850721:0:14426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787833902.851078:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787833902.851265:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787833902.851271:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787833902.853647:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787833902.853657:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787833902.856674:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787833902.856686:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787833902.857718:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787833902.857742:0:14426:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.115@tcp' 00000020:01000004:2.0:1787833902.857744:0:14426:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787833902.857801:0:14426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.115@tcp (typ=mgc) 00000020:00000080:2.0:1787833902.857825:0:14426:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.115@tcp (ffff9b6443e03490) 00000020:00000080:2.0:1787833902.857842:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787833902.858048:0:14426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b647760f000@MGC192.168.202.115@tcp: add connection 192.168.202.115@tcp at head 00010000:00010000:2.0:1787833902.858206:0:14426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.115@tcp-0 is initialized 00000040:01000000:2.0:1787833902.858213:0:14426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787833902.860059:0:14441:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787833902.860101:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.115@tcp (uuid d7c35a64-fd0d-40a9-a3ec-803aa4efddc9) 00000020:00000080:2.0:1787833902.860125:0:14426:0:(genops.c:1385:class_connect()) connect: client d7c35a64-fd0d-40a9-a3ec-803aa4efddc9, cookie 0x2bdb54ee5e775cff 00000100:00080000:2.0:1787833902.860137:0:14426:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787833902.860143:0:14426:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import ffff9b647760f000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787833902.860176:0:14426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6479ef5680 x1874679375679488/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787833902.860199:0:14426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d7c35a64-fd0d-40a9-a3ec-803aa4efddc9->MGS 00000020:01000004:2.0:1787833902.860216:0:14426:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787833902.860221:0:14426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787833902.860233:0:14426:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b6443e04ed8) 00000020:00000080:2.0:1787833902.860244:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1787833902.863858:0:14440:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1787833902.866499:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3279:1874679375679488:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787833902.866582:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833902.866657:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375679488 00000100:00100000:1.0:1787833902.866665:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375679488 00000100:00100000:1.0:1787833902.866699:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833902.866707:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3279:x1874679375679488:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787833902.866737:0:14437:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from d7c35a64-fd0d-40a9-a3ec-803aa4efddc9@0@lo t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:1.0:1787833902.867570:0:14437:0:(genops.c:1385:class_connect()) connect: client d7c35a64-fd0d-40a9-a3ec-803aa4efddc9, cookie 0x2bdb54ee5e775d0d 00000100:00080000:1.0:1787833902.867712:0:14437:0:(import.c:65:import_set_state_nolock()) ffff9b64481fb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833902.867885:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+5:3279:x1874679375679488:12345-0@lo:250:mount.lustre.0 Request processed in 1175us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833902.868463:0:3279:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787833902.868475:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.115@tcp: connect to target with instance 0 00000100:00080000:0.0:1787833902.868483:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787833902.868488:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787833902.868491:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b647760f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787833902.868494:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787833902.868505:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787833902.868512:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3279:1874679375679488:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787833902.868580:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787833902.880692:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833902.881168:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787833902.881176:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787833902.882292:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787833902.882302:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787833902.884654:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787833902.884673:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787833902.887090:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833902.887333:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787833902.887375:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787833902.894118:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787833902.894133:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787833902.933562:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833902.934282:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787833902.934290:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787833902.935710:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787833902.935720:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787833902.937741:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833902.938016:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787833902.938022:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787833902.938740:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787833902.938756:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787833902.939561:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833902.939716:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787833902.939721:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787833902.940661:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787833902.940670:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787833902.942072:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833902.942263:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787833902.942268:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787833902.943196:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787833902.943205:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787833902.963871:0:14426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787833902.964138:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787833902.964145:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787833902.966439:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787833902.966452:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787833902.975489:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787833902.975505:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787833902.977290:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787833902.977330:0:14426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787833902.977379:0:14426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787833902.977550:0:14426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787833902.977595:0:14426:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787833902.977600:0:14426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787833902.977601:0:14426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787833902.977603:0:14426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833902.977604:0:14426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833902.977605:0:14426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833902.977607:0:14426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833902.977608:0:14426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787833902.977610:0:14426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787833902.977612:0:14426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833902.977613:0:14426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787833902.977615:0:14426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787833902.977618:0:14426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787833902.977619:0:14426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787833902.977620:0:14426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833902.977621:0:14426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833902.977622:0:14426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833902.977624:0:14426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833902.977625:0:14426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787833902.977626:0:14426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787833902.977733:0:14426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833902.977734:0:14426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787833902.977843:0:14426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787833902.977862:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375679616:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787833902.977998:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833902.978050:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e130c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833902.978215:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375679616 00000100:00100000:0.0:1787833902.978223:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375679616 00000100:00100000:0.0:1787833902.978264:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833902.978271:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+5:14426:x1874679375679616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787833902.978328:0:14439:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787833902.978332:0:14439:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787833902.978335:0:14439:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787833902.979191:0:14460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787833902.979625:0:14439:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787833902.981034:0:14461:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787833902.981042:0:14461:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787833902.981045:0:14461:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787833902.981082:0:14461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787833902.981443:0:14439:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787833902.981455:0:14439:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787833902.995185:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+5:14426:x1874679375679616:12345-0@lo:253:mount.lustre.0 Request processed in 16902us (17176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833902.995201:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833902.995290:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375679616:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787833902.995306:0:14426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787833902.995310:0:14426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787833902.995311:0:14426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787833902.995313:0:14426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787833902.995314:0:14426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787833902.995478:0:14426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787833902.995480:0:14426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787833902.995481:0:14426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787833902.995483:0:14426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787833902.995485:0:14426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787833902.995486:0:14426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787833902.995574:0:14426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6477609800 from lustre-MDT0000 10000000:01000000:1.0:1787833902.995601:0:14426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787833902.995604:0:14426:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787833902.995608:0:14426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b6443e03490 10000000:01000000:1.0:1787833902.995613:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787833902.995622:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6443e03490 from 1 10000000:01000000:1.0:1787833902.995625:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787833902.995665:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833902.995675:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833902.995685:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833902.995705:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375679744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787833902.995743:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833902.995913:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13480 going to sleep for 11 seconds 00000100:00100000:2.0:1787833902.996003:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375679744 00000100:00100000:2.0:1787833902.996013:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375679744 00000100:00100000:2.0:1787833902.996087:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787833902.996097:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+5:14426:x1874679375679744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787833902.996109:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833902.996123:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6479dd2e00/0x2bdb54ee5e775d1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775d14 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833902.996155:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6479dd2e00/0x2bdb54ee5e775d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775d14 expref: 6 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833902.996163:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6479dd2e00/0x2bdb54ee5e775d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775d14 expref: 6 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833902.996172:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2e00, rc 0) 00000100:00100000:2.0:1787833902.996213:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+6:14426:x1874679375679744:12345-0@lo:101:mount.lustre.0 Request processed in 119us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833902.996219:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833902.996284:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375679744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787833902.996299:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833902.996307:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833902.996396:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375679872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787833902.996423:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833902.996817:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64508d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833902.996993:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375679872 00000100:00100000:1.0:1787833902.996999:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375679872 00000100:00100000:1.0:1787833902.997027:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833902.997034:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+6:14426:x1874679375679872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787833902.997265:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+6:14426:x1874679375679872:12345-0@lo:501:mount.lustre.0 Request processed in 231us (840us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787833902.997279:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787833902.997377:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375679872:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787833902.997404:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787833902.997424:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833902.997433:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833902.997442:0:14426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6477609800 10000000:01000000:3.0:1787833902.997446:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787833902.997450:0:14426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b6477609800 10000000:01000000:3.0:1787833902.997453:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787833902.997455:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b6477609800 from 1 10000000:01000000:3.0:1787833902.997458:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787833902.997480:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e775d22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833902.997487:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e775d22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833902.997496:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e775d22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833902.997513:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375680000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787833902.997541:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833902.997560:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64508d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833902.997725:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375680000 00000100:00100000:1.0:1787833902.997729:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375680000 00000100:00100000:1.0:1787833902.997749:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833902.997756:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+6:14426:x1874679375680000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787833902.997763:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833902.997786:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e775d29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775d22 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833902.997835:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e775d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775d22 expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833902.997846:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462199c00/0x2bdb54ee5e775d29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775d22 expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833902.997855:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199c00, rc 0) 00000100:00100000:1.0:1787833902.997882:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+7:14426:x1874679375680000:12345-0@lo:101:mount.lustre.0 Request processed in 127us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833902.997889:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833902.998631:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375680000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787833902.998647:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e775d22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d29 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833902.998655:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e775d22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775d29 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833902.998682:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787833902.998698:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e775d22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d29 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833902.998706:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2c600/0x2bdb54ee5e775d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d29 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833902.998712:0:14426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787833902.998717:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787833902.998722:0:14426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b6477609800 10000000:01000000:3.0:1787833902.998725:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787833902.998728:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787833902.998730:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787833902.998751:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e775d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833902.998758:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e775d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833902.998973:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e775d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833902.998992:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375680128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787833902.999030:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833902.999063:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64508d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833902.999116:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375680128 00000100:00100000:1.0:1787833902.999121:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375680128 00000100:00100000:1.0:1787833902.999159:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787833902.999168:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+7:14426:x1874679375680128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787833902.999176:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833902.999187:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462199200/0x2bdb54ee5e775d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775d30 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833902.999203:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199200/0x2bdb54ee5e775d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775d30 expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833902.999220:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462199200/0x2bdb54ee5e775d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775d30 expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833902.999228:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199200, rc 0) 00000100:00100000:1.0:1787833902.999268:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+8:14426:x1874679375680128:12345-0@lo:101:mount.lustre.0 Request processed in 101us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833902.999274:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833902.999547:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375680128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787833902.999559:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e775d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d37 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833902.999574:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e775d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775d37 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833902.999633:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375680256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787833902.999661:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833902.999689:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64508d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833902.999736:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375680256 00000100:00100000:1.0:1787833902.999740:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375680256 00000100:00100000:1.0:1787833902.999775:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787833902.999782:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644523c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+8:14426:x1874679375680256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787833903.000195:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644523c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+9:14426:x1874679375680256:12345-0@lo:501:mount.lustre.0 Request processed in 412us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833903.000203:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787833903.000525:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375680256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787833903.000560:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375680384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787833903.000599:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833903.000624:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64508d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833903.000701:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375680384 00000100:00100000:1.0:1787833903.000706:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375680384 00000100:00100000:1.0:1787833903.000726:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787833903.000733:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644523f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+9:14426:x1874679375680384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787833903.001151:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644523f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+9:14426:x1874679375680384:12345-0@lo:503:mount.lustre.0 Request processed in 417us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833903.001160:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787833903.001241:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375680384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787833903.003762:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14462:1874679375680512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787833903.003872:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833903.004079:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64508d5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833903.004143:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375680512 00000100:00100000:2.0:1787833903.004150:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375680512 00000100:00100000:2.0:1787833903.004282:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833903.004293:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644523e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+9:14462:x1874679375680512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833903.005144:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644523e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+9:14462:x1874679375680512:12345-0@lo:502:llog_process_th.0 Request processed in 849us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833903.005154:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787833903.006014:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14462:1874679375680512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833903.006057:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833903.006069:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833903.006072:0:14462:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787833903.006077:0:14462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787833903.006080:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833903.006096:0:14462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b6452f2ced8) 00000020:00000080:3.0:1787833903.006118:0:14462:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787833903.006123:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787833903.006189:0:14462:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787833903.006196:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e775d45 00000020:00000080:3.0:1787833903.006734:0:14462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787833903.006740:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833903.006744:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833903.006746:0:14462:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787833903.006749:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833903.006752:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833903.006754:0:14462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787833903.006758:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833903.006843:0:14462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b6452f29a48) 00000020:00000080:3.0:1787833903.006856:0:14462:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787833903.006861:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787833903.006863:0:14462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787833903.006866:0:14462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787833903.006871:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787833903.006985:0:14462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6477609800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787833903.006997:0:14462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b6452f28000) 00000020:00000080:3.0:1787833903.007009:0:14462:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787833903.007070:0:14462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787833903.007076:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e775d5a 00000020:00000080:3.0:1787833903.007167:0:14462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787833903.007173:0:14462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787833903.007178:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2bdb54ee5e775d61 00080000:01000000:3.0:1787833903.007183:0:14462:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787833903.007186:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e775d68 00010000:00010000:2.0:1787833903.096029:0:14462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787833903.097146:0:14462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787833903.097969:0:14462:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787833903.099312:0:14462:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b6443e01a48) 00000020:00000080:2.0:1787833903.099377:0:14462:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787833903.099466:0:14462:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787833903.099475:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e775d76 00000020:00000080:1.0:1787833903.100759:0:14462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787833903.108262:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2bdb54ee5e775d7d 00000020:00000080:1.0:1787833903.109569:0:14462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787833903.109583:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833903.109590:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.109592:0:14462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787833903.109602:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833903.109609:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.109610:0:14462:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787833903.109615:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787833903.109655:0:14462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787833903.109673:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833903.109677:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.109678:0:14462:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787833903.109681:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787833903.109682:0:14462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1787833903.109684:0:14462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787833903.109685:0:14462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787833903.109687:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787833903.109689:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.109691:0:14462:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787833903.109694:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787833903.109697:0:14462:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787833903.109701:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.109702:0:14462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787833903.109705:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787833903.109710:0:14462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:1.0:1787833903.109736:0:14462:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787833903.109739:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787833903.109755:0:14462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b6341b6ced8) 00000020:00000080:1.0:1787833903.109874:0:14462:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787833903.109882:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787833903.110026:0:14462:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787833903.110032:0:14462:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787833903.110039:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e775d8b 00010000:00080000:1.0:1787833903.110072:0:14462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6481734000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787833903.110288:0:14462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787833903.118021:0:14462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787833903.118078:0:14462:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787833903.119056:0:14462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787833903.119148:0:14462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787833903.119234:0:14462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787833903.120849:0:14466:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787833903.120856:0:14466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787833903.126734:0:14462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787833903.126771:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787833903.126825:0:14462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787833903.126845:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e775d92 00000100:00080000:3.0:1787833903.126856:0:14462:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787833903.126862:0:14462:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6481734000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787833903.126908:0:14462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b64623e83c0 x1874679375680640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787833903.126947:0:14462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787833903.127076:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375680640:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787833903.127136:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679375680640 offset 0 length 520: 4 00000020:01000000:3.0:1787833903.127564:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833903.127570:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833903.127572:0:14462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787833903.127576:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787833903.127578:0:14462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787833903.127580:0:14462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787833903.127581:0:14462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787833903.127583:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787833903.127585:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833903.127587:0:14462:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787833903.127589:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787833903.127593:0:14462:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787833903.127596:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833903.127597:0:14462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787833903.127600:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787833903.127604:0:14462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:3.0:1787833903.127626:0:14462:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787833903.127629:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833903.127641:0:14462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b6452f2b490) 00000020:00000080:3.0:1787833903.127656:0:14462:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787833903.127660:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787833903.127726:0:14462:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787833903.127731:0:14462:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787833903.127736:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bdb54ee5e775da0 00010000:00080000:3.0:1787833903.127834:0:14462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b645183a000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:3.0:1787833903.128108:0:14462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787833903.128305:0:14462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787833903.128328:0:14462:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787833903.132721:0:14462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787833903.132860:0:14462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787833903.134080:0:14462:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787833903.135533:0:14468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787833903.135542:0:14468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787833903.136843:0:14462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787833903.136856:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787833903.136962:0:14462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787833903.136986:0:14462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e775da7 00000100:00080000:2.0:1787833903.136997:0:14462:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787833903.137003:0:14462:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b645183a000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787833903.137040:0:14462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6479ef4000 x1874679375680768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787833903.137105:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375680768:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787833903.137164:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679375680768 offset 0 length 520: 4 00000100:00080000:2.0:1787833903.137218:0:14462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787833903.137280:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833903.137285:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833903.137287:0:14462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787833903.137290:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833903.137295:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833903.137296:0:14462:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787833903.137299:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787833903.137301:0:14462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787833903.137303:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833903.137305:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833903.137306:0:14462:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787833903.137308:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833903.137311:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833903.137312:0:14462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787833903.137316:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787833903.137384:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14462:1874679375680896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787833903.137442:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833903.137467:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444280180 going to sleep for 11 seconds 00000100:00100000:0.0:1787833903.141012:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375680896 00000100:00100000:0.0:1787833903.141027:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375680896 00000100:00100000:0.0:1787833903.141098:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787833903.141108:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+9:14462:x1874679375680896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833903.141447:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+9:14462:x1874679375680896:12345-0@lo:502:llog_process_th.0 Request processed in 340us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833903.141455:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833903.141845:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14462:1874679375680896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787833903.141880:0:14462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833903.141899:0:14462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833903.141901:0:14462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787833903.141906:0:14462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787833903.142584:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787833903.142617:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787833903.142636:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e775d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d37 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833903.142647:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d400/0x2bdb54ee5e775d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d37 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833903.142658:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6477609800 from 1 10000000:01000000:0.0:1787833903.142660:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787833903.142696:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833903.142704:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833903.142713:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833903.142746:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787833903.142798:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833903.142841:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64506fe840 going to sleep for 11 seconds 00000100:00100000:2.0:1787833903.143007:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375681024 00000100:00100000:2.0:1787833903.143014:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375681024 00000100:00100000:2.0:1787833903.143049:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833903.143057:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+9:14426:x1874679375681024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787833903.143069:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833903.143082:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775dae expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.143104:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775dae expref: 10 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.143115:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775dae expref: 10 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.143123:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2a00, rc 0) 00000100:00100000:2.0:1787833903.143157:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+10:14426:x1874679375681024:12345-0@lo:101:mount.lustre.0 Request processed in 100us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833903.143164:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787833903.143235:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787833903.143247:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833903.143256:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833903.143820:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681152:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787833903.143863:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833903.143884:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64506fe840 going to sleep for 11 seconds 00000100:00100000:2.0:1787833903.144016:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375681152 00000100:00100000:2.0:1787833903.144022:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375681152 00000100:00100000:2.0:1787833903.145143:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833903.145157:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+10:14426:x1874679375681152:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787833903.145179:0:14437:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787833903.145186:0:14437:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787833903.145285:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+10:14426:x1874679375681152:12345-0@lo:256:mount.lustre.0 Request processed in 133us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833903.145293:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787833903.145390:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681152:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787833903.146178:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787833903.146241:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.146253:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833903.146261:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6477609800 from 1 10000000:01000000:1.0:1787833903.146264:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833903.146299:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.146307:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.146326:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833903.146366:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787833903.146414:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833903.152074:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451c56900 going to sleep for 11 seconds 00000100:00100000:0.0:1787833903.156098:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375681280 00000100:00100000:0.0:1787833903.156117:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375681280 00000100:00100000:0.0:1787833903.156176:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787833903.156185:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+10:14426:x1874679375681280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787833903.156206:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833903.156230:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775dbc expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833903.156258:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775dbc expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833903.156271:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775dbc expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833903.156299:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f200, rc 0) 00000100:00100000:0.0:1787833903.156594:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14426:x1874679375681280:12345-0@lo:101:mount.lustre.0 Request processed in 408us (10178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833903.156601:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787833903.156852:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787833903.156872:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833903.156883:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833903.157124:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787833903.157165:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833903.157194:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833903.157317:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375681408 00000100:00100000:0.0:1787833903.157446:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375681408 00000100:00100000:0.0:1787833903.157473:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787833903.157479:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14426:x1874679375681408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787833903.158540:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14426:x1874679375681408:12345-0@lo:501:mount.lustre.0 Request processed in 1000us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833903.158551:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787833903.158748:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787833903.158794:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787833903.158852:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833903.159054:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6446225f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833903.159125:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375681536 00000100:00100000:2.0:1787833903.159131:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375681536 00000100:00100000:2.0:1787833903.159222:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787833903.159231:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14426:x1874679375681536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787833903.159749:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14426:x1874679375681536:12345-0@lo:503:mount.lustre.0 Request processed in 517us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833903.159764:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833903.159925:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787833903.160537:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14470:1874679375681664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833903.160588:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833903.160949:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451c56600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833903.161092:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375681664 00000100:00100000:0.0:1787833903.161099:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375681664 00000100:00100000:0.0:1787833903.161132:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787833903.161139:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14470:x1874679375681664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833903.161409:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14470:x1874679375681664:12345-0@lo:502:llog_process_th.0 Request processed in 269us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833903.161417:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787833903.161911:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14470:1874679375681664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833903.161941:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833903.161950:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.161952:0:14470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787833903.161958:0:14470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6477609800 00000020:00000080:1.0:1787833903.161969:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787833903.161977:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833903.161980:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.161981:0:14470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787833903.161983:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833903.161985:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.161986:0:14470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787833903.161990:0:14470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6477609800 00000020:00000080:1.0:1787833903.161991:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787833903.162061:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833903.162065:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.162066:0:14470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787833903.162069:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787833903.162071:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.162073:0:14470:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787833903.162077:0:14470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6477609800 00000020:00000080:1.0:1787833903.162078:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787833903.162121:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14470:1874679375681792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833903.162163:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833903.162187:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451c56600 going to sleep for 11 seconds 00000100:00100000:1.0:1787833903.169414:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375681792 00000100:00100000:1.0:1787833903.169430:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375681792 00000100:00100000:1.0:1787833903.169475:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787833903.169485:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14470:x1874679375681792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787833903.175399:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14470:x1874679375681792:12345-0@lo:502:llog_process_th.0 Request processed in 5831us (13152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833903.175413:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787833903.175497:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14470:1874679375681792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787833903.175531:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787833903.175540:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787833903.175542:0:14470:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787833903.175547:0:14470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787833903.176427:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787833903.176450:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787833903.176471:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.176483:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833903.176529:0:14426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787833903.176532:0:14426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6477609800 10000000:01000000:2.0:1787833903.176534:0:14426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6477609800 10000000:01000000:2.0:1787833903.176538:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787833903.176544:0:14426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b6477609800 from 1 10000000:01000000:2.0:1787833903.176546:0:14426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833903.177450:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2600/0x2bdb54ee5e775dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.177462:0:14426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2600/0x2bdb54ee5e775dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.177473:0:14426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2600/0x2bdb54ee5e775dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833903.177493:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787833903.177550:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833903.177584:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444280180 going to sleep for 11 seconds 00000100:00100000:2.0:1787833903.177603:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375681920 00000100:00100000:2.0:1787833903.177608:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375681920 00000100:00100000:2.0:1787833903.177649:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787833903.177656:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14426:x1874679375681920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787833903.177669:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833903.177679:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6479dd2000/0x2bdb54ee5e775dd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775dca expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.177700:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6479dd2000/0x2bdb54ee5e775dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775dca expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.177710:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6479dd2000/0x2bdb54ee5e775dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775dca expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.177718:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2000, rc 0) 00000100:00100000:2.0:1787833903.177748:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14426:x1874679375681920:12345-0@lo:101:mount.lustre.0 Request processed in 92us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833903.177754:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787833903.177785:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375681920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787833903.177797:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2600/0x2bdb54ee5e775dca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775dd1 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.177817:0:14426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2600/0x2bdb54ee5e775dca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775dd1 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833903.177866:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375682048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833903.179450:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833903.179498:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444280180 going to sleep for 11 seconds 00000100:00100000:0.0:1787833903.179587:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375682048 00000100:00100000:0.0:1787833903.179595:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375682048 00000100:00100000:0.0:1787833903.179638:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787833903.179646:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14426:x1874679375682048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787833903.180036:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14426:x1874679375682048:12345-0@lo:501:mount.lustre.0 Request processed in 389us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833903.180044:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787833903.180140:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375682048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833903.180180:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375682176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787833903.180226:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833903.181440:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444280180 going to sleep for 11 seconds 00000100:00100000:0.0:1787833903.187030:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375682176 00000100:00100000:0.0:1787833903.187047:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375682176 00000100:00100000:0.0:1787833903.187114:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787833903.187125:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14426:x1874679375682176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787833903.191815:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14426:x1874679375682176:12345-0@lo:503:mount.lustre.0 Request processed in 4673us (11569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833903.191832:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787833903.192025:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375682176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787833903.196506:0:14475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14475:1874679375682304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833903.196596:0:14475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833903.196644:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375682304 00000100:00100000:0.0:1787833903.196651:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375682304 00000100:00100000:0.0:1787833903.196696:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787833903.196704:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14475:x1874679375682304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833903.197038:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14475:x1874679375682304:12345-0@lo:502:llog_process_th.0 Request processed in 334us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833903.197046:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787833903.197095:0:14475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833903.197115:0:14475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14475:1874679375682304:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787833903.197171:0:14475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787833903.197184:0:14475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b6479ca8000) 00000020:00000080:0.0:1787833903.197204:0:14475:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787833903.197272:0:14475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6477609800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787833903.197276:0:14475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6477609800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787833903.197278:0:14475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b6477609800 4 00010000:00080000:0.0:1787833903.197306:0:14475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6468da0800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:0.0:1787833903.202773:0:14475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787833903.203674:0:14475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787833903.203716:0:14475:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787833903.203728:0:14475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2bdb54ee5e775ddf 00000100:00080000:0.0:1787833903.203740:0:14475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787833903.203746:0:14475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b6468da0800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787833903.203796:0:14475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b647f93b840 x1874679375682432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787833903.203836:0:14475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787833903.205727:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375682432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787833903.205819:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833903.208287:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375682432 00000100:00100000:3.0:1787833903.208302:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375682432 00000100:00100000:3.0:1787833903.209124:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787833903.209134:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1874679375682432:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787833903.209234:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1874679375682432:12345-0@lo:38:llog_process_th.0 Request processed in 101us (3415us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787833903.209242:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787833903.209306:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787833903.209315:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b6468da0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833903.209329:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787833903.209334:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375682432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787833903.209495:0:14475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14475:1874679375682560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833903.209549:0:14475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833903.209576:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375682560 00000100:00100000:0.0:1787833903.209581:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375682560 00000100:00100000:0.0:1787833903.209611:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787833903.209618:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14475:x1874679375682560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787833903.209852:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14475:x1874679375682560:12345-0@lo:502:llog_process_th.0 Request processed in 234us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833903.209859:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787833903.209980:0:14475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6460194f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833903.209994:0:14475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14475:1874679375682560:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787833903.210014:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787833903.211389:0:14426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787833903.211416:0:14426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787833903.211432:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2600/0x2bdb54ee5e775dca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775dd1 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.211443:0:14426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2600/0x2bdb54ee5e775dca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775dd1 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787833903.211494:0:14426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787833903.211496:0:14426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787833903.211497:0:14426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833903.211498:0:14426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833903.211499:0:14426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833903.211501:0:14426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833903.211502:0:14426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787833903.211503:0:14426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787833903.211505:0:14426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833903.211506:0:14426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787833903.211510:0:14426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787833903.211513:0:14426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787833903.211514:0:14426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787833903.211515:0:14426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787833903.211516:0:14426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787833903.211518:0:14426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787833903.211524:0:14426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787833903.211525:0:14426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787833903.211526:0:14426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787833903.211526:0:14426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787833903.211527:0:14426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787833903.211549:0:14426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787833903.211565:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375682688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787833903.211619:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833903.211649:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6444c11a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787833903.211939:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375682688 00000100:00100000:0.0:1787833903.211946:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375682688 00000100:00100000:0.0:1787833903.211995:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787833903.212004:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14426:x1874679375682688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787833903.212029:0:14438:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787833903.212049:0:14438:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787833903.260078:0:14438:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787833903.260095:0:14438:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787833903.260179:0:14460:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787833903.260184:0:14460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787833903.260207:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.260227:0:14460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775dae expref: 12 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.260235:0:14460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.260273:0:14460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e775dae expref: 12 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833903.260288:0:14460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e775dae expref: 12 pid: 14438 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833903.260304:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14460:1874679375682816:0@lo:104: 00000100:00100000:2.0:1787833903.260395:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833903.260445:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450914540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833903.260522:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375682816 00000100:00100000:1.0:1787833903.260531:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375682816 00000100:00100000:1.0:1787833903.260582:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833903.260594:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:14460:x1874679375682816:12345-0@lo:104: 00010000:00010000:1.0:1787833903.260619:0:14427:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.260672:0:14427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833903.260678:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:14460:x1874679375682816:12345-0@lo:104: Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833903.260685:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787833903.260704:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833903.260709:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.260716:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e400 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:1.0:1787833903.260720:0:14433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.260729:0:14433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833903.260747:0:14433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833903.260753:0:14433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787833903.260922:0:14433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.260929:0:14433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833903.260950:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.260957:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b647751e400/0x2bdb54ee5e775dae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775db5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.260973:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833903.260975:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833903.260976:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833903.261006:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3280:1874679375682944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833903.261038:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833903.261114:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375682944 00000100:00100000:1.0:1787833903.261119:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375682944 00010000:00010000:1.0:1787833903.261137:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775dae expref: 13 pid: 14438 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833903.261159:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833903.261164:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+13:3280:x1874679375682944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833903.261173:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833903.261177:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775dae expref: 13 pid: 14438 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261193:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e775dae expref: 13 pid: 14438 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261210:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261218:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787833903.261231:0:14429:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001048376s 00010000:00010000:1.0:1787833903.261235:0:14429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261242:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261248:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261254:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261261:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833903.261265:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261271:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261279:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261294:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833903.261325:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+13:3280:x1874679375682944:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833903.261332:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833903.261399:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3280:1874679375682944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833903.261427:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6479dd2a00/0x2bdb54ee5e775db5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e775dae expref: 12 pid: 14438 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833903.261436:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14460:1874679375682816:0@lo:104: 00010000:00010000:1.0:1787833903.261447:0:14460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261455:0:14460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261461:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833903.261466:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6479dd3400/0x2bdb54ee5e775de6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833903.275199:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14426:x1874679375682688:12345-0@lo:253:mount.lustre.0 Request processed in 62269us (62652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833903.275216:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787833903.275441:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14426:1874679375682688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787833903.275458:0:14426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787833903.275461:0:14426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787833903.275462:0:14426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787833903.275463:0:14426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833903.275464:0:14426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833903.275465:0:14426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833903.275481:0:14426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833903.275482:0:14426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787833903.275483:0:14426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787833903.275485:0:14426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833903.275486:0:14426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787833903.275501:0:14426:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787833903.284178:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833903.284525:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833903.285003:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833903.285150:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833903.285970:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833903.286144:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833903.289449:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833903.289967:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833903.290784:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833903.291113:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833903.291457:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833903.291621:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787833903.335169:0:14426:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787833903.335884:0:14426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787833903.335960:0:14483:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787833903.335965:0:14483:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787833903.337452:0:14484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787833903.337520:0:14484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787833903.341613:0:14426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787833903.343310:0:14426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787833903.343979:0:14484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787833903.344069:0:14484:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787833903.344073:0:14484:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1787833903.344748:0:14426:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787833903.344957:0:14426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787833903.345306:0:14426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787833903.346989:0:14426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787833903.347704:0:14426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787833903.347967:0:14426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787833903.351838:0:14426:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787833903.359510:0:14426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787833903.395494:0:14426:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787833903.395534:0:14426:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc19741547988 00100000:10000000:1.0:1787833903.395542:0:14426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787833903.396717:0:14426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787833903.396733:0:14426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787833903.396759:0:14426:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1787833903.396977:0:14426:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787833903.873224:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787833904.259109:0:14477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787833904.573459:0:14441:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787833904.573467:0:14441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6477609800 from 6 10000000:01000000:1.0:1787833904.573473:0:14441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787833904.573531:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833904.573543:0:14441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833904.573563:0:14441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833904.573588:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375683072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833904.573674:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833904.573733:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452de5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787833904.573951:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375683072 00000100:00100000:2.0:1787833904.573958:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375683072 00000100:00100000:2.0:1787833904.573998:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833904.574006:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14441:x1874679375683072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833904.574018:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833904.574029:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775ded expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833904.574049:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775ded expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833904.574059:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775ded expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833904.574067:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2400, rc 0) 00000100:00100000:2.0:1787833904.574103:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14441:x1874679375683072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833904.574109:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787833904.574148:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375683072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833904.574174:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833904.574182:0:14441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833904.574234:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375683200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787833904.574259:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833904.574271:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64451c6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833904.575405:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375683200 00000100:00100000:1.0:1787833904.575415:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375683200 00000100:00100000:1.0:1787833904.575462:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787833904.575471:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14441:x1874679375683200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787833904.575491:0:14437:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787833904.575522:0:14437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787833904.575525:0:14437:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787833904.575863:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14441:x1874679375683200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 391us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833904.575871:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787833904.575988:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375683200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787833904.576035:0:14441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787833904.576043:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833904.576052:0:14441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833904.901433:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787833905.279173:0:14477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787833905.927136:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833906.948106:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833907.964862:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787833908.284489:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787833908.284497:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787833908.284499:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787833908.284502:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787833908.284505:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787833908.284508:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787833908.284512:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b6468da0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787833908.284524:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b6468da0800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787833908.284547:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b647f9392c0 x1874679375683456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787833908.284605:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375683456:0@lo:38:kworker.0 00000100:00100000:0.0:1787833908.284699:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833908.285009:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3281:1874679375683328:0@lo:400:kworker.0 00000100:00100000:1.0:1787833908.285048:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833908.285174:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375683456 00000100:00100000:3.0:1787833908.285184:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375683456 00000100:00100000:3.0:1787833908.285226:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787833908.285233:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1874679375683456:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787833908.285264:0:14446:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 387 last 0 00000020:00000080:3.0:1787833908.285374:0:14446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2bdb54ee5e775dfb 00000004:00100000:3.0:1787833908.285402:0:14446:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787833908.285537:0:14446:0:(import.c:65:import_set_state_nolock()) ffff9b6475d29800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833908.285596:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1874679375683456:12345-0@lo:38:kworker.0 Request processed in 362us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833908.285603:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833908.285910:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375683328 00000100:00100000:0.0:1787833908.285915:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375683328 00000100:00100000:0.0:1787833908.285954:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787833908.285962:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:3281:x1874679375683328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833908.286002:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:3281:x1874679375683328:12345-0@lo:400:kworker.0 Request processed in 42us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833908.286009:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787833908.286069:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b647f9392c0 x1874679375683456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787833908.286085:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787833908.286093:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787833908.286098:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787833908.286100:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b6468da0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787833908.286106:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1874679375683456:0@lo:38:kworker.0 00000100:00100000:1.0:1787833908.286196:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3281:1874679375683328:0@lo:400:kworker.0 00000001:02000400:2.0:1787833908.724212:0:14727:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787833908.996930:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833910.016279:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787833910.932613:0:14879:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb52d8980 20000000:00000080:2.0:1787833910.932632:0:14879:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6481acd800 uarg=0000000000000000 20000000:01000000:2.0:1787833910.932664:0:14879:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787833910.932671:0:14879:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787833910.932676:0:14879:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787833910.935100:0:14880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787833910.935254:0:14879:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787833910.947790:0:14879:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787833910.947828:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833910.948205:0:14879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775dbc expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833910.948215:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833910.948261:0:14879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e775dbc expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833910.948279:0:14879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e775dbc expref: 11 pid: 14438 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833910.948295:0:14879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14879:1874679375683584:0@lo:104: 00000100:00100000:2.0:1787833910.948413:0:14879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833910.948480:0:14879:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64460c43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833910.948593:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375683584 00000100:00100000:0.0:1787833910.948601:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375683584 00000100:00100000:0.0:1787833910.948645:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833910.948653:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:14879:x1874679375683584:12345-0@lo:104: 00010000:00010000:0.0:1787833910.948667:0:14428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833910.948743:0:14428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787833910.948750:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:14879:x1874679375683584:12345-0@lo:104: Request processed in 99us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833910.948757:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787833910.948779:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833910.948785:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833910.948792:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199000 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:0.0:1787833910.948796:0:14433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833910.948817:0:14433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787833910.948825:0:14433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833910.948831:0:14433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787833910.948874:0:14433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833910.948881:0:14433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787833910.948898:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833910.948905:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462199000/0x2bdb54ee5e775dbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775dc3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833910.948921:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833910.948922:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833910.948924:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833910.949078:0:14879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14879:1874679375683584:0@lo:104: 00010000:00010000:2.0:1787833910.949097:0:14879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833910.949924:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3282:1874679375683712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833910.949971:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833910.950156:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375683712 00000100:00100000:1.0:1787833910.950163:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375683712 00010000:00010000:1.0:1787833910.950203:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775dbc expref: 12 pid: 14438 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833910.950237:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787833910.950245:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:3282:x1874679375683712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833910.950257:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833910.950262:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775dbc expref: 12 pid: 14438 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950274:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e775dbc expref: 12 pid: 14438 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950291:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b647751f200/0x2bdb54ee5e775dc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e775dbc expref: 12 pid: 14438 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950317:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950328:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950376:0:14429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950385:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950392:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950400:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950406:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3c00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833910.950411:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950420:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950436:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833910.950446:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833910.950485:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:3282:x1874679375683712:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833910.950498:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833910.950629:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3282:1874679375683712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833910.950700:0:14879:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833910.950708:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833910.950715:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6479dd3c00/0x2bdb54ee5e775e02 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833911.038463:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833912.061467:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787833912.765009:0:14441:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787833912.765018:0:14441:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6477609800 from 10 10000000:01000000:1.0:1787833912.765025:0:14441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833912.765069:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.765081:0:14441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.765092:0:14441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833912.765131:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375683840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833912.765209:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833912.765264:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833912.765325:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375683840 00000100:00100000:0.0:1787833912.765332:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375683840 00000100:00100000:0.0:1787833912.765397:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787833912.765407:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+11:14441:x1874679375683840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833912.765419:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833912.765433:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775e09 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833912.765469:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e09 expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833912.765480:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e09 expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833912.765488:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751ee00, rc 0) 00000100:00100000:0.0:1787833912.765539:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14441:x1874679375683840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833912.765555:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787833912.765903:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375683840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833912.765919:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833912.765929:0:14441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833912.765995:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375683968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833912.766029:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833912.766058:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601ebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833912.766093:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375683968 00000100:00100000:1.0:1787833912.766098:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375683968 00000100:00100000:1.0:1787833912.766136:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787833912.766144:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14441:x1874679375683968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833912.766413:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14441:x1874679375683968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833912.766420:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787833912.766475:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375683968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833912.766511:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375684096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787833912.766548:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833912.766564:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601ebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787833912.766632:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375684096 00000100:00100000:0.0:1787833912.766637:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375684096 00000100:00100000:0.0:1787833912.766664:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787833912.766671:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14441:x1874679375684096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833912.766852:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:14441:x1874679375684096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833912.766859:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787833912.766923:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375684096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787833912.769312:0:14959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787833912.769416:0:14441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787833912.769438:0:14441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833912.769450:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833912.769472:0:14441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833913.099306:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833913.404573:0:3279:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787833903/real 1787833903] req@ffff9b6479ef4000 x1874679375680768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787833913 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833913.404607:0:3279:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6479ef4000 x1874679375680768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787833913 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833913.404619:0:3279:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787833903/real 1787833903] req@ffff9b64623e83c0 x1874679375680640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787833913 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833913.404631:0:3279:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b64623e83c0 x1874679375680640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787833913 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787833913.404681:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b645183a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787833913.404691:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787833913.404694:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375680768:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787833913.404701:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b6481734000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787833913.404705:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787833913.404707:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375680640:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787833913.405053:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787833913.405058:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787833913.405060:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b6481734000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787833913.405065:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 381 00000100:00080000:1.0:1787833913.405070:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787833913.405076:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6481734000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787833913.405097:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6477407840 x1874679375684352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787833913.405113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787833913.405116:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787833913.405118:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b645183a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787833913.405121:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 381 00000100:00080000:1.0:1787833913.405124:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787833913.405128:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b645183a000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787833913.405138:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6477405a40 x1874679375684480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787833913.405178:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375684608:0@lo:400:kworker.0 00000100:00100000:1.0:1787833913.405243:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833913.405309:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375684352:0@lo:8:kworker.0 00000400:00000100:1.0:1787833913.405328:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679375684352 offset 0 length 520: 4 00000100:00100000:1.0:1787833913.405388:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375684480:0@lo:8:kworker.0 00000400:00000100:1.0:1787833913.405405:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874679375684480 offset 0 length 520: 4 00000100:00100000:3.0:1787833913.405593:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375684224:0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.405628:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833913.406012:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375684608 00000100:00100000:3.0:1787833913.406019:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375684608 00000100:00100000:3.0:1787833913.406071:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787833913.406080:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375684608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833913.406139:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375684608:12345-0@lo:400:kworker.0 Request processed in 60us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833913.406147:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787833913.406457:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6477404780 x1874679375684608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833913.406480:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375684608:0@lo:400:kworker.0 00000100:00100000:0.0:1787833913.407871:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375684224 00000100:00100000:0.0:1787833913.407884:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375684224 00000100:00100000:0.0:1787833913.407941:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787833913.407952:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:3283:x1874679375684224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833913.409644:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:3283:x1874679375684224:12345-0@lo:400:kworker.0 Request processed in 1687us (4007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833913.409658:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787833913.420070:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375684224:0@lo:400:kworker.0 00010000:00010000:3.0:1787833914.117158:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833915.136925:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787833915.516934:0:14477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1787833915.674166:0:15127:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787833915.674170:0:15127:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787833915.674320:0:15127:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b647760c800 00000020:01000004:2.0:1787833915.674373:0:15127:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787833915.674384:0:15127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787833915.674409:0:15127:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b6450399a48) 00000020:00000080:2.0:1787833915.674427:0:15127:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787833915.692218:0:15127:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787833915.692656:0:15127:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787833915.694113:0:15127:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787833915.694607:0:15127:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787833915.695506:0:15127:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787833915.695942:0:15127:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 539: rc = 0 00100000:10000000:2.0:1787833915.696037:0:15127:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:2.0:1787833915.696134:0:15127:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 539: rc = 0 00100000:10000000:2.0:1787833915.697012:0:15127:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 667: rc = 0 00100000:10000000:2.0:1787833915.697217:0:15127:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 667: rc = 0 00100000:10000000:2.0:1787833915.698591:0:15127:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 667: rc = 0 00100000:10000000:2.0:1787833915.698889:0:15127:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 667: rc = 0 00100000:10000000:2.0:1787833915.699121:0:15127:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 667: rc = 0 00100000:10000000:2.0:1787833915.699887:0:15127:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 667: rc = 0 00000020:00000080:2.0:1787833915.700664:0:15127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787833915.700676:0:15127:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787833915.700687:0:15127:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bdb54ee5e775e1e 00000020:01000004:2.0:1787833915.700718:0:15127:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787833915.700739:0:15127:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787833915.700742:0:15127:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787833915.700748:0:15127:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787833915.700752:0:15127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787833915.700763:0:15127:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b645039b490) 00000020:00000080:2.0:1787833915.700773:0:15127:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787833915.704086:0:15127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787833915.704275:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787833915.704280:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787833915.705611:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787833915.705620:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787833915.706094:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787833915.706100:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787833915.707943:0:15127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833915.708119:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787833915.708126:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787833915.709164:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787833915.709172:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787833915.731267:0:15127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833915.731771:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787833915.731778:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787833915.734007:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787833915.734020:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787833915.736573:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787833915.736590:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787833915.744636:0:15127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833915.744868:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787833915.744875:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787833915.745887:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787833915.745898:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787833915.800391:0:15127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787833915.800607:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787833915.800614:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787833915.801672:0:15127:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787833915.801682:0:15127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787833915.802079:0:15127:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787833915.802104:0:15127:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787833915.802110:0:15127:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787833915.810088:0:15127:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787833915.810126:0:15127:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787833915.810131:0:15127:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787833915.810133:0:15127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833915.810134:0:15127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833915.810135:0:15127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833915.810137:0:15127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833915.810138:0:15127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833915.810140:0:15127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833915.810142:0:15127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833915.810143:0:15127:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833915.810147:0:15127:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787833915.810149:0:15127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787833915.810151:0:15127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833915.810152:0:15127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833915.810153:0:15127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833915.810154:0:15127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833915.810155:0:15127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833915.810156:0:15127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833915.810164:0:15127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833915.810165:0:15127:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787833915.810202:0:15127:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787833915.810226:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375684736:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787833915.810304:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.810450:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833915.810499:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375684736 00000100:00100000:1.0:1787833915.810508:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375684736 00000100:00100000:1.0:1787833915.810610:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787833915.810620:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:15127:x1874679375684736:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787833915.810651:0:14437:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787833915.810654:0:14437:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787833915.810659:0:14437:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787833915.816984:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:15127:x1874679375684736:12345-0@lo:253:mount.lustre.0 Request processed in 6357us (6671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.816999:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787833915.817097:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375684736:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787833915.817114:0:15127:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787833915.817117:0:15127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787833915.817119:0:15127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833915.817120:0:15127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833915.817121:0:15127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833915.817122:0:15127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833915.817124:0:15127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833915.817126:0:15127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833915.817128:0:15127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833915.817130:0:15127:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787833915.817151:0:15127:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b647760c800 from lustre-OST0000 10000000:01000000:2.0:1787833915.817180:0:15127:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787833915.817183:0:15127:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787833915.817192:0:15127:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6443e03490 local copy 00010000:00010000:2.0:1787833915.817203:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833915.817506:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375684864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833915.817543:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.817615:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824240 going to sleep for 11 seconds 00000100:00100000:0.0:1787833915.817721:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375684864 00000100:00100000:0.0:1787833915.817728:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375684864 00000100:00100000:0.0:1787833915.817817:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787833915.817827:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:15127:x1874679375684864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787833915.817986:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:15127:x1874679375684864:12345-0@lo:501:mount.lustre.0 Request processed in 161us (442us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833915.817993:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787833915.818059:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375684864:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787833915.818072:0:15127:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787833915.818200:0:15127:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787833915.818206:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.818221:0:15127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833915.818246:0:15127:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b647760c800 10000000:01000000:2.0:1787833915.818257:0:15127:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787833915.818263:0:15127:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b6443e03490 10000000:01000000:2.0:1787833915.818265:0:15127:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787833915.818269:0:15127:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b6443e03490 from 1 10000000:01000000:2.0:1787833915.818272:0:15127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787833915.818295:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3e00/0x2bdb54ee5e775e2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.818302:0:15127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3e00/0x2bdb54ee5e775e2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.818311:0:15127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3e00/0x2bdb54ee5e775e2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833915.818322:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375684992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787833915.818385:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.818523:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824240 going to sleep for 11 seconds 00000100:00100000:1.0:1787833915.818590:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375684992 00000100:00100000:1.0:1787833915.818595:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375684992 00000100:00100000:1.0:1787833915.818619:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787833915.818627:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+12:15127:x1874679375684992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787833915.818637:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833915.818650:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462199600/0x2bdb54ee5e775e33 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775e2c expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.818681:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199600/0x2bdb54ee5e775e33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e2c expref: 13 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.818702:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462199600/0x2bdb54ee5e775e33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e2c expref: 13 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.818713:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199600, rc 0) 00000100:00100000:1.0:1787833915.818878:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+13:15127:x1874679375684992:12345-0@lo:101:mount.lustre.0 Request processed in 251us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.818885:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787833915.818950:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375684992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787833915.818963:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3e00/0x2bdb54ee5e775e2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e33 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.818971:0:15127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3e00/0x2bdb54ee5e775e2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775e33 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833915.818999:0:15127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787833915.819050:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3e00/0x2bdb54ee5e775e2c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e33 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.819058:0:15127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3e00/0x2bdb54ee5e775e2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e33 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833915.819066:0:15127:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787833915.819069:0:15127:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787833915.819074:0:15127:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787833915.819077:0:15127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787833915.819091:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2c00/0x2bdb54ee5e775e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.819099:0:15127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2c00/0x2bdb54ee5e775e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.819106:0:15127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2c00/0x2bdb54ee5e775e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833915.819118:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787833915.819145:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.819167:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824240 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.819203:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375685120 00000100:00100000:3.0:1787833915.819208:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375685120 00000100:00100000:3.0:1787833915.819251:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787833915.819258:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+13:15127:x1874679375685120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787833915.819266:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833915.819276:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2c000/0x2bdb54ee5e775e41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775e3a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.819290:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2c000/0x2bdb54ee5e775e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e3a expref: 14 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.819299:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2c000/0x2bdb54ee5e775e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e3a expref: 14 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.819306:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c000, rc 0) 00000100:00100000:3.0:1787833915.819334:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685120:12345-0@lo:101:mount.lustre.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.819363:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787833915.819442:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787833915.819452:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2c00/0x2bdb54ee5e775e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e41 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.819460:0:15127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2c00/0x2bdb54ee5e775e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775e41 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787833915.820123:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787833915.820987:0:15127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787833915.821230:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787833915.821274:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787833915.821310:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787833915.821406:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787833915.821445:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787833915.821479:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787833915.821559:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787833915.821566:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787833915.821636:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833915.821710:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.821749:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.821921:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375685248 00000100:00100000:3.0:1787833915.821927:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375685248 00000100:00100000:3.0:1787833915.821971:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787833915.821980:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685248:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787833915.822305:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685248:12345-0@lo:501:mount.lustre.0 Request processed in 326us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.822313:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787833915.822608:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833915.822643:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787833915.822758:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.822824:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.822858:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375685376 00000100:00100000:3.0:1787833915.822862:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375685376 00000100:00100000:3.0:1787833915.822927:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787833915.822936:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685376:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787833915.823771:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685376:12345-0@lo:503:mount.lustre.0 Request processed in 832us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.823782:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787833915.823913:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685376:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787833915.824579:0:15127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787833915.824729:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787833915.824782:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.824877:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.824937:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375685504 00000100:00100000:3.0:1787833915.824943:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375685504 00000100:00100000:3.0:1787833915.824988:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787833915.824997:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685504:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787833915.825214:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685504:12345-0@lo:502:mount.lustre.0 Request processed in 217us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.825221:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787833915.825389:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787833915.825645:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787833915.825719:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787833915.825766:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787833915.825816:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787833915.825854:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787833915.825901:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787833915.825949:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787833915.825985:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787833915.826015:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787833915.826072:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787833915.826108:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787833915.826168:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787833915.826200:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787833915.826245:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.826275:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824600 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.826475:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375685632 00000100:00100000:3.0:1787833915.826481:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375685632 00000100:00100000:3.0:1787833915.826523:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787833915.826531:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787833915.826856:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685632:12345-0@lo:502:mount.lustre.0 Request processed in 325us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.826863:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787833915.826947:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787833915.827017:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787833915.827027:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787833915.827972:0:15141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787833915.827982:0:15141:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787833915.827988:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833915.827991:0:15141:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787833915.827995:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787833915.828011:0:15141:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b6450398000) 00000020:00000080:2.0:1787833915.828034:0:15141:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787833915.828040:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787833915.828115:0:15141:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b647760c800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787833915.828123:0:15141:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787833915.828133:0:15141:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bdb54ee5e775e4f 00010000:00010000:2.0:1787833915.831802:0:15141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787833915.832221:0:15141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787833915.834294:0:15141:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787833915.835968:0:15141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787833915.835986:0:15141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833915.835992:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833915.835994:0:15141:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787833915.835998:0:15141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787833915.836000:0:15141:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787833915.836002:0:15141:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787833915.836003:0:15141:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787833915.836004:0:15141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787833915.836007:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833915.836008:0:15141:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787833915.836010:0:15141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833915.836012:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833915.836014:0:15141:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787833915.836017:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787833915.836019:0:15141:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787833915.836021:0:15141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833915.836023:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833915.836024:0:15141:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787833915.836026:0:15141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833915.836028:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833915.836030:0:15141:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787833915.836032:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787833915.836091:0:15141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833915.836095:0:15141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833915.836097:0:15141:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787833915.836100:0:15141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787833915.836270:0:15127:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787833915.836304:0:15127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787833915.836332:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2c00/0x2bdb54ee5e775e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e41 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.836575:0:15127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6479dd2c00/0x2bdb54ee5e775e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e41 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833915.836585:0:15127:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b647760c800 from 1 10000000:01000000:3.0:1787833915.836588:0:15127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833915.836624:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.836632:0:15127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.836644:0:15127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833915.836746:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787833915.836818:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833915.836893:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64601b1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787833915.840500:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375685760 00000100:00100000:2.0:1787833915.840514:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375685760 00000100:00100000:2.0:1787833915.840624:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787833915.840635:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+14:15127:x1874679375685760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787833915.840663:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833915.840681:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775e56 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.840732:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e56 expref: 15 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.840744:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e56 expref: 15 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.840752:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3800, rc 0) 00000100:00100000:2.0:1787833915.840837:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375685760:12345-0@lo:101:mount.lustre.0 Request processed in 204us (4018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833915.840844:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787833915.840939:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787833915.840958:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.840977:0:15127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833915.841510:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787833915.843620:0:15127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833915.844038:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787833915.844085:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787833915.844145:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787833915.844153:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787833915.844251:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787833915.844317:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.844496:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451c56900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.844771:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375685888 00000100:00100000:3.0:1787833915.844779:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375685888 00000100:00100000:3.0:1787833915.844830:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787833915.844841:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375685888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787833915.845085:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375685888:12345-0@lo:501:mount.lustre.0 Request processed in 246us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.845093:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787833915.847236:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375685888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787833915.847289:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787833915.847385:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.847422:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451c56900 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.847514:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375686016 00000100:00100000:3.0:1787833915.847521:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375686016 00000100:00100000:3.0:1787833915.847579:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787833915.847588:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375686016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787833915.847884:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375686016:12345-0@lo:503:mount.lustre.0 Request processed in 297us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.847892:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787833915.847982:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686016:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787833915.848904:0:15127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787833915.848978:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787833915.849038:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.849071:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442bab240 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.849144:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375686144 00000100:00100000:3.0:1787833915.849150:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375686144 00000100:00100000:3.0:1787833915.849191:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787833915.849199:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375686144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787833915.849398:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375686144:12345-0@lo:502:mount.lustre.0 Request processed in 200us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.849405:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787833915.849565:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787833915.849895:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787833915.849944:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787833915.849989:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787833915.850036:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787833915.850068:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787833915.850115:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787833915.850150:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787833915.850184:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787833915.850213:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787833915.850256:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.850435:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451c56900 going to sleep for 11 seconds 00000100:00100000:1.0:1787833915.851147:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375686272 00000100:00100000:1.0:1787833915.851161:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375686272 00000100:00100000:1.0:1787833915.851247:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787833915.851257:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375686272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787833915.851600:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375686272:12345-0@lo:502:mount.lustre.0 Request processed in 344us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.851608:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787833915.851793:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787833915.851903:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787833915.851917:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787833915.852782:0:15145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833915.852793:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833915.852796:0:15145:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787833915.852802:0:15145:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b647760c800 00000020:00000080:3.0:1787833915.852805:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787833915.852812:0:15145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833915.852814:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833915.852816:0:15145:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787833915.852818:0:15145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833915.852820:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833915.852822:0:15145:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787833915.852825:0:15145:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b647760c800 00000020:00000080:3.0:1787833915.852827:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787833915.852925:0:15145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833915.852929:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833915.852930:0:15145:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787833915.852933:0:15145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787833915.852935:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833915.852941:0:15145:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787833915.852946:0:15145:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b647760c800 00000020:00000080:3.0:1787833915.852948:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787833915.859277:0:15145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787833915.859290:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833915.859292:0:15145:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787833915.859298:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787833915.870080:0:15127:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787833915.870135:0:15127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787833915.870160:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.870173:0:15127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833915.870232:0:15127:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787833915.870235:0:15127:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b647760c800 10000000:01000000:0.0:1787833915.870239:0:15127:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b647760c800 10000000:01000000:0.0:1787833915.870243:0:15127:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787833915.870249:0:15127:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b647760c800 from 1 10000000:01000000:0.0:1787833915.870253:0:15127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787833915.870290:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647751fa00/0x2bdb54ee5e775e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.870299:0:15127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b647751fa00/0x2bdb54ee5e775e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.870325:0:15127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b647751fa00/0x2bdb54ee5e775e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833915.870371:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787833915.870445:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.870484:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833915.870809:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375686400 00000100:00100000:1.0:1787833915.870817:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375686400 00000100:00100000:1.0:1787833915.870865:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787833915.870875:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375686400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787833915.870888:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833915.870901:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e775e6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775e64 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.870926:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e775e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e64 expref: 16 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.870937:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6462199000/0x2bdb54ee5e775e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e64 expref: 16 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.870946:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6462199000, rc 0) 00000100:00100000:1.0:1787833915.870995:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375686400:12345-0@lo:101:mount.lustre.0 Request processed in 121us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.871002:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787833915.871791:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787833915.871811:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b647751fa00/0x2bdb54ee5e775e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e6b expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.871821:0:15127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b647751fa00/0x2bdb54ee5e775e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775e6b expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833915.872435:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787833915.873034:0:15127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833915.873264:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787833915.873309:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787833915.873764:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787833915.873823:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787833915.873863:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787833915.873911:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787833915.873947:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787833915.873982:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787833915.874030:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787833915.874067:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787833915.874099:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787833915.874144:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787833915.874180:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787833915.874214:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787833915.874276:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787833915.874318:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787833915.874554:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787833915.874605:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787833915.879214:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787833915.879323:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787833915.879447:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787833915.879486:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787833915.879519:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787833915.879566:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787833915.879602:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787833915.879635:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787833915.879683:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787833915.879808:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787833915.879901:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787833915.879909:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787833915.880022:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787833915.880094:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.880151:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787833915.880393:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375686528 00000100:00100000:1.0:1787833915.880402:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375686528 00000100:00100000:1.0:1787833915.880459:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787833915.880470:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375686528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787833915.880777:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375686528:12345-0@lo:501:mount.lustre.0 Request processed in 308us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.880785:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787833915.880941:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787833915.880977:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787833915.881026:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.881053:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787833915.881094:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375686656 00000100:00100000:2.0:1787833915.881099:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375686656 00000100:00100000:2.0:1787833915.881129:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787833915.881136:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375686656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787833915.881410:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375686656:12345-0@lo:503:mount.lustre.0 Request processed in 274us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833915.881417:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787833915.881958:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f9392c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787833915.886877:0:15127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787833915.886997:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787833915.887079:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833915.887128:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64622b99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833915.887982:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375686784 00000100:00100000:3.0:1787833915.887993:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375686784 00000100:00100000:3.0:1787833915.888063:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787833915.888076:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375686784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787833915.888563:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375686784:12345-0@lo:502:mount.lustre.0 Request processed in 489us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833915.888572:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787833915.888748:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787833915.889066:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787833915.889120:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787833915.889155:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787833915.889200:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787833915.889230:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787833915.889271:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787833915.889319:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787833915.889457:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787833915.889518:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787833915.889556:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787833915.889591:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787833915.889637:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787833915.889754:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787833915.889783:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787833915.889821:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787833915.889849:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787833915.889874:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787833915.889914:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787833915.889942:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787833915.889968:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787833915.890003:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787833915.890041:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787833915.890078:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787833915.890123:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787833915.890160:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787833915.890194:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787833915.890250:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787833915.890287:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787833915.890321:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787833915.890511:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787833915.890550:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787833915.890584:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787833915.890619:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787833915.890747:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787833915.890787:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787833915.890833:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787833915.890868:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787833915.890902:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787833915.890966:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787833915.891004:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787833915.891049:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787833915.891119:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833915.891748:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64622b99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833915.893644:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375686912 00000100:00100000:2.0:1787833915.893659:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375686912 00000100:00100000:2.0:1787833915.893734:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787833915.893746:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375686912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787833915.894003:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375686912:12345-0@lo:502:mount.lustre.0 Request processed in 259us (2882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833915.894011:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787833915.894035:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375686912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787833915.894147:0:15127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787833915.894162:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787833915.895572:0:15150:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787833915.895589:0:15150:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b6341b69a48) 00000020:00000080:1.0:1787833915.895610:0:15150:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787833915.895758:0:15150:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b647760c800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787833915.895763:0:15150:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b647760c800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787833915.895765:0:15150:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b647760c800 3 00010000:00080000:1.0:1787833915.895818:0:15150:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b63427c5800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787833915.897916:0:15150:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787833915.898182:0:15150:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787833915.898217:0:15150:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787833915.898230:0:15150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2bdb54ee5e775e79 00000100:00080000:1.0:1787833915.898241:0:15150:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787833915.898246:0:15150:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b63427c5800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787833915.898282:0:15150:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6477404b40 x1874679375687040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787833915.898311:0:15150:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787833915.898390:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787833915.898395:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787833915.898405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787833915.898408:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787833915.898425:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1874679375687040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787833915.898466:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833915.898475:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375687168:0@lo:400:kworker.0 00000100:00100000:0.0:1787833915.898495:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.898624:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833915.898687:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375687040 00000100:00100000:0.0:1787833915.898704:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375687040 00000100:00100000:0.0:1787833915.898743:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375687168 00000100:00100000:0.0:1787833915.898746:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375687168 00000100:00100000:0.0:1787833915.898771:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833915.898779:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375687168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833915.898826:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375687168:12345-0@lo:400:kworker.0 Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833915.898833:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833915.898846:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833915.898850:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3279:x1874679375687040:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787833915.898870:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6479ef6580 x1874679375687168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787833915.898878:0:14445:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 394 last 0 00000100:00100000:2.0:1787833915.898882:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375687168:0@lo:400:kworker.0 00000020:00000080:0.0:1787833915.898902:0:14445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2bdb54ee5e775e80 00000004:00100000:0.0:1787833915.898919:0:14445:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787833915.898949:0:14445:0:(import.c:65:import_set_state_nolock()) ffff9b6468da4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787833915.898995:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1874679375687040:12345-0@lo:38:llog_process_th.0 Request processed in 143us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833915.899002:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787833915.899025:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6477404b40 x1874679375687040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833915.899034:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787833915.899040:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787833915.899046:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787833915.899049:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787833915.899052:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b63427c5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787833915.899057:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1874679375687040:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787833915.899194:0:15150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787833915.899733:0:15127:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787833915.899768:0:15127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787833915.899790:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647751fa00/0x2bdb54ee5e775e64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e6b expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833915.899800:0:15127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b647751fa00/0x2bdb54ee5e775e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e6b expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787833915.899849:0:15127:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787833915.899854:0:15127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833915.899856:0:15127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833915.899857:0:15127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833915.899858:0:15127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833915.899859:0:15127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833915.899860:0:15127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833915.899862:0:15127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833915.899863:0:15127:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787833915.899867:0:15127:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787833915.899882:0:15127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787833915.899883:0:15127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833915.899884:0:15127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833915.899885:0:15127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833915.899886:0:15127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833915.899887:0:15127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833915.899888:0:15127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833915.899889:0:15127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833915.899890:0:15127:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787833915.899915:0:15127:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787833915.899928:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375687296:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787833915.899970:0:15127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833915.900003:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452de5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833915.900409:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375687296 00000100:00100000:0.0:1787833915.900415:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375687296 00000100:00100000:0.0:1787833915.900450:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787833915.900461:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15127:x1874679375687296:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787833915.900484:0:14437:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787833915.900497:0:14437:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787833915.932551:0:14437:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787833915.932565:0:14437:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787833915.932572:0:14460:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787833915.932578:0:14460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787833915.932602:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.932621:0:14460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775ded expref: 16 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.932630:0:14460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.932681:0:14460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e775ded expref: 16 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.932857:0:14460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e775ded expref: 16 pid: 14439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833915.932886:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64774052c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14460:1874679375687424:0@lo:104: 00000100:00100000:1.0:1787833915.932962:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833915.933011:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64503ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833915.935200:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375687424 00000100:00100000:0.0:1787833915.935214:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375687424 00000100:00100000:0.0:1787833915.935261:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787833915.935280:0:14427:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787833915.935284:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477406d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:14460:x1874679375687424:12345-0@lo:104: 00000100:00100000:1.0:1787833915.935289:0:14427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1787833915.935303:0:14428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833915.935409:0:14428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787833915.935416:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64774052c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14460:1874679375687424:0@lo:104: 00000100:00100000:0.0:1787833915.935416:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477406d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:14460:x1874679375687424:12345-0@lo:104: Request processed in 134us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833915.935424:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787833915.935437:0:14460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.935806:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833915.935813:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.935821:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199e00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:3.0:1787833915.935825:0:14433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.935834:0:14433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833915.935841:0:14433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833915.935847:0:14433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787833915.935969:0:14433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.935982:0:14433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787833915.936030:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3282:1874679375687552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787833915.936065:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833915.936138:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375687552 00000100:00100000:1.0:1787833915.936143:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375687552 00010000:00010000:1.0:1787833915.936162:0:14431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775ded expref: 17 pid: 14439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833915.936184:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787833915.936191:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:3282:x1874679375687552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833915.936202:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833915.936206:0:14431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775ded expref: 17 pid: 14439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936216:0:14431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e775ded expref: 17 pid: 14439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936230:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6479dd2400/0x2bdb54ee5e775df4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e775ded expref: 17 pid: 14439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936243:0:14431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936251:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787833915.936275:0:14431:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003698007s 00010000:00010000:1.0:1787833915.936280:0:14431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936292:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936298:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936303:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936308:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833915.936311:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936318:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936330:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.936364:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833915.936427:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.936435:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462199e00/0x2bdb54ee5e775ded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775df4 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833915.936449:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833915.936451:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833915.936453:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833915.937021:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:3282:x1874679375687552:12345-0@lo:103:ldlm_bl.0 Request processed in 827us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.937030:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787833915.937222:0:14460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.937231:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833915.937237:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6462198000/0x2bdb54ee5e775e87 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833915.937946:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3282:1874679375687552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833915.941422:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:15127:x1874679375687296:12345-0@lo:253:mount.lustre.0 Request processed in 40957us (41444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833915.941433:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787833915.941546:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15127:1874679375687296:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787833915.941558:0:15127:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787833915.941561:0:15127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787833915.941562:0:15127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787833915.941563:0:15127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787833915.941564:0:15127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787833915.941565:0:15127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787833915.941566:0:15127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787833915.941567:0:15127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787833915.941568:0:15127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787833915.941569:0:15127:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787833915.941581:0:15127:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787833915.952991:0:15127:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833915.953167:0:15127:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833915.953329:0:15127:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833915.953489:0:15127:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833915.953618:0:15127:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833915.953798:0:15127:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787833915.954557:0:15127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787833916.005582:0:15127:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787833916.005590:0:15127:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787833916.005623:0:15127:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787833916.005713:0:15127:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787833916.005736:0:15127:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787833916.005764:0:15127:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787833916.157581:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787833916.988759:0:14441:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787833916.988768:0:14441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6477609800 from 7 10000000:01000000:1.0:1787833916.988773:0:14441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787833916.988823:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.988834:0:14441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.988846:0:14441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833916.988870:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64774061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375687680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833916.988946:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833916.988997:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341184a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833916.989041:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375687680 00000100:00100000:3.0:1787833916.989049:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375687680 00000100:00100000:3.0:1787833916.989100:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787833916.989108:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+15:14441:x1874679375687680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833916.989120:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833916.989133:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775e8e expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.989155:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e8e expref: 16 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.989183:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e8e expref: 16 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.989193:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2c400, rc 0) 00000100:00100000:3.0:1787833916.989236:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:14441:x1874679375687680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833916.989242:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787833916.989374:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64774061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375687680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833916.989388:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833916.989397:0:14441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833916.990450:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64774061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375687808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787833916.990502:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833916.990553:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341184a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787833916.990658:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375687808 00000100:00100000:3.0:1787833916.990665:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375687808 00000100:00100000:3.0:1787833916.990721:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787833916.990730:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645924a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:14441:x1874679375687808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787833916.990749:0:14437:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787833916.990765:0:14437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787833916.990768:0:14437:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787833916.990853:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645924a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:14441:x1874679375687808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833916.990860:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787833916.990904:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64774061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375687808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787833916.990969:0:14441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787833916.990977:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833916.990986:0:14441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833917.181041:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833918.204553:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833919.229474:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833920.253589:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787833921.084868:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787833921.084874:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787833921.084876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787833921.084879:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787833921.084924:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375687936:0@lo:400:kworker.0 00000100:00100000:3.0:1787833921.085020:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833921.085096:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375688064:0@lo:400:kworker.0 00000100:00100000:3.0:1787833921.085142:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833921.085165:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833921.085171:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375688192:0@lo:400:kworker.0 00000100:00100000:3.0:1787833921.085198:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833921.085234:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375687936 00000100:00100000:3.0:1787833921.085243:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375687936 00000100:00100000:3.0:1787833921.085288:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787833921.085296:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:3283:x1874679375687936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833921.085372:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:3283:x1874679375687936:12345-0@lo:400:kworker.0 Request processed in 77us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833921.085379:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787833921.085413:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375688064 00000100:00100000:3.0:1787833921.085416:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375688064 00000100:00100000:3.0:1787833921.085441:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375688192 00000100:00100000:3.0:1787833921.085444:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375688192 00000100:00100000:3.0:1787833921.085469:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833921.085475:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375688064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833921.085521:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375688064:12345-0@lo:400:kworker.0 Request processed in 46us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833921.085528:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833921.085540:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787833921.085546:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375688192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833921.085571:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375688192:12345-0@lo:400:kworker.0 Request processed in 27us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833921.085577:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787833921.085621:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623ebc00 x1874679375688192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833921.085637:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375688192:0@lo:400:kworker.0 00010000:00080000:3.0:1787833921.085659:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623ea580 x1874679375688064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833921.085668:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375688064:0@lo:400:kworker.0 00000100:00100000:3.0:1787833921.085699:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375687936:0@lo:400:kworker.0 00000100:00080000:3.0:1787833921.085814:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787833921.278415:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787833921.318142:0:15497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787833922.300611:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833923.332482:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833924.358831:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833925.372632:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787833925.760079:0:14477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1787833926.212124:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787833926.212135:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787833926.212138:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787833926.212142:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787833926.212458:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375688448:0@lo:400:kworker.0 00000100:00100000:0.0:1787833926.212536:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833926.212607:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787833926.212615:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375688320:0@lo:400:kworker.0 00000100:00100000:0.0:1787833926.212648:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833926.212742:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375688576:0@lo:400:kworker.0 00000100:00100000:1.0:1787833926.212777:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833926.212811:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375688320 00000100:00100000:1.0:1787833926.212818:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375688320 00000100:00100000:1.0:1787833926.212860:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787833926.212868:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:3283:x1874679375688320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833926.213075:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375688448 00000100:00100000:0.0:1787833926.213079:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375688448 00000100:00100000:0.0:1787833926.213106:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375688576 00000100:00100000:0.0:1787833926.213108:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375688576 00000100:00100000:0.0:1787833926.213132:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787833926.213138:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375688448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833926.213177:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874679375688448:12345-0@lo:400:kworker.0 Request processed in 39us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833926.213198:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833926.213849:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833926.213861:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375688576:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787833926.214108:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787833926.214138:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6479ef52c0 x1874679375688448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833926.214153:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874679375688448:0@lo:400:kworker.0 00000100:00100000:3.0:1787833926.223072:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375688576:12345-0@lo:400:kworker.0 Request processed in 9203us (10283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833926.223087:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787833926.223358:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6479ef7480 x1874679375688576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833926.223379:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375688576:0@lo:400:kworker.0 00000100:00100000:1.0:1787833926.232058:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:3283:x1874679375688320:12345-0@lo:400:kworker.0 Request processed in 19181us (19399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833926.232074:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787833926.232573:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375688320:0@lo:400:kworker.0 00010000:00010000:2.0:1787833926.399617:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833927.420701:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833928.132389:0:3279:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787833913/real 1787833913] req@ffff9b6477407840 x1874679375684352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787833928 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833928.132422:0:3279:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6477407840 x1874679375684352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787833928 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833928.132432:0:3279:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787833913/real 1787833913] req@ffff9b6477405a40 x1874679375684480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787833928 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833928.132442:0:3279:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6477405a40 x1874679375684480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787833928 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787833928.132461:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b6481734000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833928.132478:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787833928.132482:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375684352:0@lo:8:kworker.0 00000100:00080000:3.0:1787833928.132487:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b645183a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833928.132492:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787833928.132495:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375684480:0@lo:8:kworker.0 00000100:00080000:3.0:1787833928.132570:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787833928.132574:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787833928.132577:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b6481734000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787833928.132593:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 392 00000100:00080000:3.0:1787833928.132599:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787833928.132606:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6481734000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787833928.132626:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b64623ebc00 x1874679375688832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787833928.132638:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787833928.132652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787833928.132654:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b645183a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787833928.132657:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 392 00000100:00080000:3.0:1787833928.132660:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787833928.132664:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b645183a000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787833928.132676:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b64623e9a40 x1874679375688960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833928.132723:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3281:1874679375688704:0@lo:400:kworker.0 00000100:00100000:3.0:1787833928.132790:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833928.132847:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375689088:0@lo:400:kworker.0 00000100:00100000:3.0:1787833928.132876:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833928.132898:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833928.132904:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375689216:0@lo:400:kworker.0 00000100:00100000:3.0:1787833928.132925:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833928.132973:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375688704 00000100:00100000:3.0:1787833928.132980:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375688704 00000100:00100000:3.0:1787833928.133025:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787833928.133035:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:3281:x1874679375688704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833928.133084:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:3281:x1874679375688704:12345-0@lo:400:kworker.0 Request processed in 50us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833928.133091:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787833928.133124:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375689088 00000100:00100000:3.0:1787833928.133128:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375689088 00000100:00100000:3.0:1787833928.133151:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375689216 00000100:00100000:3.0:1787833928.133154:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375689216 00000100:00100000:3.0:1787833928.133178:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787833928.133193:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375689088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833928.134938:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375689088:12345-0@lo:400:kworker.0 Request processed in 1739us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833928.134949:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787833928.134978:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787833928.134989:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375689216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833928.135025:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375689216:12345-0@lo:400:kworker.0 Request processed in 40us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833928.135031:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787833928.135065:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787833928.135099:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623ead00 x1874679375689216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833928.135114:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375689216:0@lo:400:kworker.0 00010000:00080000:3.0:1787833928.135126:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623e8f00 x1874679375689088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833928.135135:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375689088:0@lo:400:kworker.0 00000100:00100000:3.0:1787833928.135172:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3281:1874679375688704:0@lo:400:kworker.0 00000100:00100000:3.0:1787833928.135192:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375688832:0@lo:8:kworker.0 00000100:00100000:3.0:1787833928.135744:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833928.135788:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375688960:0@lo:8:kworker.0 00000100:00100000:3.0:1787833928.135837:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.135946:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375688832 00000100:00100000:2.0:1787833928.135953:0:15128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375688832 00000100:00100000:2.0:1787833928.135980:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375688960 00000100:00100000:2.0:1787833928.135983:0:15128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375688960 00000100:00100000:2.0:1787833928.135995:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833928.136001:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1874679375688832:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787833928.136026:0:15128:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:2.0:1787833928.136054:0:15128:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e775e9c 00002000:00100000:2.0:1787833928.136079:0:15128:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b6447cde000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787833928.136084:0:15128:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787833928.136087:0:15128:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787833928.136487:0:15128:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787833928.136514:0:15128:0:(import.c:65:import_set_state_nolock()) ffff9b6447cd8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833928.136567:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1874679375688832:12345-0@lo:8:kworker.0 Request processed in 565us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.136574:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833928.136602:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833928.136606:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1874679375688960:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787833928.136617:0:15128:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787833928.136644:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1874679375688960:12345-0@lo:8:kworker.0 Request processed in 36us (806us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787833928.136650:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787833928.137784:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64623ebc00 x1874679375688832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787833948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833928.137796:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787833928.137814:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787833928.137822:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787833928.137828:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787833928.137830:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b6481734000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787833928.137848:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787833928.137853:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375688832:0@lo:8:kworker.0 00000100:00080000:3.0:1787833928.137867:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b645183a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787833928.137871:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787833928.137873:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375688960:0@lo:8:kworker.0 00000004:00080000:2.0:1787833928.137994:0:14467:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787833928.138015:0:14467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14467:1874679375689472:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787833928.138055:0:14467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.138141:0:14467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477824e40 going to sleep for 11 seconds 00000004:00080000:2.0:1787833928.138158:0:14466:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787833928.138427:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375689344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833928.138458:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833928.138508:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375689472 00000100:00100000:3.0:1787833928.138514:0:15128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375689472 00000100:00100000:3.0:1787833928.138555:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787833928.138562:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14467:x1874679375689472:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787833928.139771:0:14466:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406895429228ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787833928.139817:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375689344 00000100:00100000:2.0:1787833928.139823:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375689344 00000100:00100000:2.0:1787833928.139857:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787833928.139864:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874679375689344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833928.139889:0:15132:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833928.139948:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1874679375689344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.139955:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787833928.147690:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787833928.153621:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6479ef7480 x1874679375689344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787833928.153650:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375689344:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1787833928.168576:0:15128:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787833928.168601:0:15128:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787833928.168607:0:15128:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1787833928.200421:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.200435:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200453:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787833928.200458:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.200466:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200484:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200494:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200503:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200535:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787833928.200557:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833928.200563:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200571:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ea00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833928.200575:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200594:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200610:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200617:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014153cc7/0x2bdb54ee5e775ea3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.200634:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833928.200636:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833928.200638:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787833928.201683:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.201691:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201703:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787833928.201712:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.201718:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201728:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201736:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201744:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201763:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787833928.201773:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833928.201778:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201784:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833928.201787:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201795:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201806:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201824:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775eaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.201839:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833928.201840:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833928.201842:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787833928.205384:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.205397:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.205414:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787833928.205419:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.205426:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.205440:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.205449:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.205457:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.205486:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833928.205786:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.205793:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.205802:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fe00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.205806:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.205815:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.205834:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.205853:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba679ccc/0x2bdb54ee5e775eb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.205874:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.205876:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.205877:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787833928.205965:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.205976:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.205984:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787833928.205988:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.205992:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.206000:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.206007:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.206013:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.206034:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833928.206130:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.206148:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.206156:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.206178:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.206187:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.206232:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.206281:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000768eb810/0x2bdb54ee5e775eb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.206308:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.206310:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.206311:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787833928.211332:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.211366:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.211384:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787833928.211388:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.211394:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.211407:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.211424:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.211432:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.211448:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833928.212123:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.212132:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.212140:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.212144:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.212153:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.212169:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.212177:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002166419a/0x2bdb54ee5e775ebf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.212196:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.212198:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.212199:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787833928.217024:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.217038:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.219155:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787833928.219169:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.219180:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.219200:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.219211:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.219220:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.219769:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833928.222424:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833928.222437:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.222465:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833928.222470:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.222480:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.222504:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.222511:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003207a405/0x2bdb54ee5e775ec6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.222541:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833928.222543:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833928.222545:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787833928.235824:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.235839:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.235857:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1787833928.235862:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.235869:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.235903:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.235914:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.235923:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.235944:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833928.235958:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.235965:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.235972:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199a00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.235976:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.235985:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236001:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236008:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf10bdf6/0x2bdb54ee5e775ecd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236034:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.236036:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.236038:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787833928.236697:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.236703:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236713:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1787833928.236716:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.236720:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236729:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236737:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236745:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236764:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833928.236773:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.236776:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236794:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.236797:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236804:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236815:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236823:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ea3903f/0x2bdb54ee5e775ed4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.236837:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.236838:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.236840:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787833928.237251:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.237258:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237266:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1787833928.237269:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.237273:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237281:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237295:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237302:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237316:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833928.237325:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.237329:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237337:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.237365:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237372:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237383:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237391:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f422d5d3/0x2bdb54ee5e775edb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237403:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.237411:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.237412:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787833928.237802:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.237807:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237816:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1787833928.237819:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.237824:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237833:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237841:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237849:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237863:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833928.237872:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.237876:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237883:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462199e00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.237887:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237910:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237921:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237929:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076eb7ff0/0x2bdb54ee5e775ee2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.237942:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.237944:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.237946:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787833928.238381:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.238387:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238396:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1787833928.238399:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.238403:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238412:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238419:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238433:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238447:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833928.238457:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.238461:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238468:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.238472:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238480:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238493:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238502:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030768d33/0x2bdb54ee5e775ee9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.238515:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.238516:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.238518:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787833928.251685:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787833928.258114:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.258134:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258151:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1787833928.258156:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.258163:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258179:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258190:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258199:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258234:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787833928.258673:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.258679:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258689:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1787833928.258692:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.258696:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258706:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258721:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258729:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.258747:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787833928.259097:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.259102:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259110:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1787833928.259113:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.259117:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259126:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259134:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259142:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259160:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787833928.259559:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.259565:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259574:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1787833928.259577:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.259596:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259606:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259613:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259620:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259628:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787833928.259964:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.259970:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.259978:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1787833928.259987:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.259991:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.260000:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.260008:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.260016:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.260023:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787833928.260438:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787833928.260444:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.260453:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1787833928.260456:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833928.260460:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.260469:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.260477:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.260490:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.260499:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1787833928.262166:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787833928.262177:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262189:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833928.262194:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262204:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262224:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262233:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065133431/0x2bdb54ee5e775ef0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262256:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787833928.262260:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262266:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd7a00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833928.262269:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262283:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262294:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262301:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0efdb32/0x2bdb54ee5e775ef7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262313:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787833928.262317:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262323:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd7c00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833928.262326:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262333:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262370:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262377:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000291210d3/0x2bdb54ee5e775efe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262402:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787833928.262406:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262413:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833928.262416:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262424:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262434:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262440:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064d71204/0x2bdb54ee5e775f05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262451:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787833928.262454:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262460:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd7800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833928.262463:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262482:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262493:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262500:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b71271db/0x2bdb54ee5e775f0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262511:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833928.262514:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262521:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd7000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833928.262524:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262531:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262540:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262547:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ff51eb3/0x2bdb54ee5e775f13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.262571:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833928.262572:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833928.262574:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833928.263194:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787833928.269095:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.269108:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269126:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1787833928.269131:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.269138:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269151:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269161:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269169:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269197:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833928.269660:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1787833928.269660:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.269666:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269667:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269676:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833928.269681:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269687:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1787833928.269690:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.269695:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269704:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269708:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269712:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269719:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269725:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269732:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b134edcb/0x2bdb54ee5e775f1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.269736:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833928.269751:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833928.269755:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269761:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ec00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833928.269765:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269772:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269781:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269789:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a20eb587/0x2bdb54ee5e775f21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.269811:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833928.269813:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833928.269815:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787833928.270109:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.270114:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270122:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1787833928.270125:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.270129:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270137:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270156:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270163:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270183:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787833928.270649:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.270655:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270658:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833928.270662:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270664:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1787833928.270667:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833928.270670:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833928.270672:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270673:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270681:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270682:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270689:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270697:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270701:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270707:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b393d466/0x2bdb54ee5e775f28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.270717:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833928.270720:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833928.270723:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270729:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833928.270737:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270745:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270755:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270763:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f1c98c/0x2bdb54ee5e775f2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.270774:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833928.270776:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833928.270777:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787833928.271103:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787833928.271109:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.271118:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1787833928.271121:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833928.271125:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.271134:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.271141:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.271149:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833928.271169:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833928.271292:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833928.271297:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.271304:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fc00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833928.271308:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.271316:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.271327:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.271360:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b7294d/0x2bdb54ee5e775f36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.271372:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833928.271373:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833928.271375:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833928.271932:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833928.288983:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833928.289001:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.289019:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1787833928.289023:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833928.289041:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.289060:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.289073:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.289081:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.289112:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787833928.289797:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833928.289803:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.289812:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1787833928.289815:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833928.289820:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.289828:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.289836:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.289853:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.290766:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787833928.291529:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833928.291536:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.291552:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1787833928.291556:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833928.291562:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.291574:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.291597:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833928.291605:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.291973:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787833928.291983:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.291992:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.291996:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292006:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292025:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292032:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c98242cf/0x2bdb54ee5e775f3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292048:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787833928.292052:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292071:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2dc00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.292074:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292082:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292092:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292099:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046235683/0x2bdb54ee5e775f44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292112:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.292115:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292122:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ca00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.292124:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292131:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292140:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.292152:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.292154:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.292156:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833928.292439:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833928.292608:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787833928.292615:0:15128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001bd61d5/0x2bdb54ee5e775f4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.293058:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787833928.301048:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833928.301061:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301078:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=407s v=(0 0) 00010000:00010000:2.0:1787833928.301083:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833928.301089:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301104:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301115:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301122:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301151:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787833928.301766:0:15128:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833928.301778:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301788:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=407s v=(0 0) 00010000:00010000:2.0:1787833928.301791:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833928.301796:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301805:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301813:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301819:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833928.301839:0:15128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1787833928.302015:0:15128:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787833928.302123:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14467:x1874679375689472:12345-0@lo:5:osp-pre-0-0.0 Request processed in 163557us (164063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833928.302133:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787833928.302195:0:14467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14467:1874679375689472:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787833928.302210:0:14467:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787833928.302256:0:14467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14467:1874679375689600:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787833928.302291:0:14467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833928.302371:0:14467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833928.302388:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375689600 00000100:00100000:2.0:1787833928.302395:0:15128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375689600 00000100:00100000:2.0:1787833928.302434:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833928.302443:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14467:x1874679375689600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787833928.302482:0:15128:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1787833928.304694:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787833928.304717:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304732:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.304738:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304750:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304772:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304781:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eab63d5/0x2bdb54ee5e775f52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304803:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833928.304807:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304813:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833928.304829:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304837:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304849:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304856:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775f59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833928.304870:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.304871:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833928.304874:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833928.305048:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833928.326328:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14467:x1874679375689600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23879us (24029us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787833928.326370:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833928.326797:0:14467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14467:1874679375689600:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787833928.326813:0:14467:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787833928.446421:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833929.468549:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787833930.250481:0:15847:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787833930.250485:0:15847:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787833930.250604:0:15847:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b646dc8e000 00000020:01000004:2.0:1787833930.250621:0:15847:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787833930.250634:0:15847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787833930.250652:0:15847:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b645039ced8) 00000020:00000080:2.0:1787833930.250670:0:15847:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787833930.269520:0:15847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787833930.269850:0:15847:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787833930.270858:0:15847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787833930.271109:0:15847:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787833930.271649:0:15847:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787833930.272007:0:15847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 513: rc = 0 00100000:10000000:2.0:1787833930.272116:0:15847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 513: rc = 0 00100000:10000000:2.0:1787833930.272448:0:15847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:2.0:1787833930.273044:0:15847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 650: rc = 0 00100000:10000000:2.0:1787833930.273379:0:15847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 650: rc = 0 00100000:10000000:2.0:1787833930.273680:0:15847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 650: rc = 0 00100000:10000000:2.0:1787833930.273953:0:15847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 650: rc = 0 00100000:10000000:2.0:1787833930.274203:0:15847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 650: rc = 0 00100000:10000000:2.0:1787833930.274507:0:15847:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 650: rc = 0 00000020:00000080:2.0:1787833930.275545:0:15847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787833930.275570:0:15847:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787833930.275584:0:15847:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bdb54ee5e775f67 00000020:01000004:2.0:1787833930.275592:0:15847:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787833930.275616:0:15847:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787833930.275619:0:15847:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787833930.275779:0:15847:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787833930.275802:0:15847:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787833930.275806:0:15847:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787833930.284790:0:15847:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787833930.284845:0:15847:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.115@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787833930.284849:0:15847:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787833930.284851:0:15847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833930.284853:0:15847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833930.284854:0:15847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833930.284856:0:15847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833930.284857:0:15847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833930.284859:0:15847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833930.284874:0:15847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833930.284876:0:15847:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787833930.284880:0:15847:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787833930.284882:0:15847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787833930.284884:0:15847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833930.284885:0:15847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833930.284886:0:15847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833930.284887:0:15847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833930.284888:0:15847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833930.284890:0:15847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833930.284891:0:15847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833930.284892:0:15847:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787833930.284926:0:15847:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787833930.284952:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375689728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787833930.285052:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833930.285120:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341f479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.285127:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375689728 00000100:00100000:1.0:1787833930.285138:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375689728 00000100:00100000:1.0:1787833930.285204:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787833930.285217:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15847:x1874679375689728:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787833930.285258:0:14439:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787833930.285262:0:14439:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787833930.285266:0:14439:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787833930.300134:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15847:x1874679375689728:12345-0@lo:253:mount.lustre.0 Request processed in 14906us (15069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833930.300150:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787833930.300171:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375689728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787833930.300187:0:15847:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787833930.300207:0:15847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787833930.300209:0:15847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833930.300210:0:15847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833930.300211:0:15847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833930.300212:0:15847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833930.300214:0:15847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833930.300215:0:15847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833930.300218:0:15847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833930.300219:0:15847:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787833930.300247:0:15847:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b646dc8e000 from lustre-OST0001 10000000:01000000:3.0:1787833930.300278:0:15847:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787833930.300280:0:15847:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787833930.300288:0:15847:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6443e03490 local copy 00010000:00010000:3.0:1787833930.300297:0:15847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833930.300639:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375689856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787833930.300677:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833930.300740:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341f47480 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.300791:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375689856 00000100:00100000:1.0:1787833930.300799:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375689856 00000100:00100000:1.0:1787833930.300884:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787833930.300895:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15847:x1874679375689856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787833930.301078:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15847:x1874679375689856:12345-0@lo:501:mount.lustre.0 Request processed in 185us (401us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787833930.301094:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787833930.301162:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375689856:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787833930.301179:0:15847:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787833930.301381:0:15847:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787833930.301388:0:15847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833930.301403:0:15847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6462198e00/0x2bdb54ee5e775d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775d1b expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787833930.301427:0:15847:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b646dc8e000 10000000:01000000:0.0:1787833930.301433:0:15847:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787833930.301438:0:15847:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787833930.301440:0:15847:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787833930.301445:0:15847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787833930.301449:0:15847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787833930.301474:0:15847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647751e200/0x2bdb54ee5e775f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833930.301483:0:15847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b647751e200/0x2bdb54ee5e775f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833930.301493:0:15847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b647751e200/0x2bdb54ee5e775f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833930.301509:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375689984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787833930.301569:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833930.301887:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528fa180 going to sleep for 11 seconds 00000100:00100000:3.0:1787833930.301933:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375689984 00000100:00100000:3.0:1787833930.301939:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375689984 00000100:00100000:3.0:1787833930.301973:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787833930.301982:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:15847:x1874679375689984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787833930.301991:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833930.302005:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e775f75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775f6e expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.302029:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e775f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775f6e expref: 17 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.302040:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6442a2ca00/0x2bdb54ee5e775f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775f6e expref: 17 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.302065:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6442a2ca00, rc 0) 00000100:00100000:3.0:1787833930.302198:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375689984:12345-0@lo:101:mount.lustre.0 Request processed in 216us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833930.302205:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787833930.302378:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375689984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787833930.302393:0:15847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b647751e200/0x2bdb54ee5e775f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775f75 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833930.302402:0:15847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b647751e200/0x2bdb54ee5e775f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775f75 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833930.303709:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787833930.304785:0:15847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833930.305035:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787833930.305425:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787833930.305470:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787833930.305599:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787833930.305634:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787833930.305655:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787833930.305732:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787833930.305741:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787833930.305816:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787833930.305879:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833930.305922:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833930.305989:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375690112 00000100:00100000:2.0:1787833930.305996:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375690112 00000100:00100000:2.0:1787833930.306161:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787833930.306169:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375690112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833930.307085:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375690112:12345-0@lo:501:mount.lustre.0 Request processed in 914us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833930.307096:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787833930.307218:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787833930.307413:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787833930.307457:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833930.307517:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528faf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.307598:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375690240 00000100:00100000:1.0:1787833930.307603:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375690240 00000100:00100000:1.0:1787833930.307632:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787833930.307640:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375690240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787833930.308007:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375690240:12345-0@lo:503:mount.lustre.0 Request processed in 368us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.308015:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787833930.308149:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690240:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787833930.308754:0:15847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787833930.308823:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787833930.308873:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833930.308910:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833930.308984:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375690368 00000100:00100000:2.0:1787833930.308989:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375690368 00000100:00100000:2.0:1787833930.309026:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787833930.309034:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375690368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787833930.310400:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375690368:12345-0@lo:502:mount.lustre.0 Request processed in 1358us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833930.310423:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787833930.310440:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f93a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787833930.310774:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787833930.310811:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787833930.310827:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787833930.310852:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787833930.311424:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787833930.311449:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787833930.311477:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787833930.311495:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787833930.311518:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787833930.311556:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787833930.311686:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833930.311718:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341f476c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.311736:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375690496 00000100:00100000:1.0:1787833930.311743:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375690496 00000100:00100000:1.0:1787833930.311781:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787833930.311791:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375690496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787833930.311957:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375690496:12345-0@lo:502:mount.lustre.0 Request processed in 168us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.311964:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787833930.312052:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787833930.312149:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787833930.312156:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787833930.312981:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787833930.312990:0:15848:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787833930.312997:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787833930.313000:0:15848:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787833930.313005:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787833930.313029:0:15848:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b63418e3490) 00000020:00000080:3.0:1787833930.313060:0:15848:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787833930.313179:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787833930.313304:0:15848:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b646dc8e000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787833930.313311:0:15848:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787833930.313316:0:15848:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bdb54ee5e775f83 00010000:00010000:3.0:1787833930.316971:0:15848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787833930.317490:0:15848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787833930.319785:0:15848:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787833930.321173:0:15848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787833930.321186:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833930.321193:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833930.321195:0:15848:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787833930.321199:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833930.321203:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833930.321205:0:15848:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787833930.321208:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787833930.321209:0:15848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787833930.321212:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833930.321214:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833930.321216:0:15848:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787833930.321217:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787833930.321220:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833930.321222:0:15848:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787833930.321225:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787833930.321296:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787833930.321300:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787833930.321302:0:15848:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787833930.321306:0:15848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787833930.327441:0:15847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787833930.327501:0:15847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787833930.327529:0:15847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647751e200/0x2bdb54ee5e775f6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775f75 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.327542:0:15847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b647751e200/0x2bdb54ee5e775f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775f75 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833930.327551:0:15847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b646dc8e000 from 1 10000000:01000000:3.0:1787833930.327554:0:15847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833930.327604:0:15847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.327612:0:15847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.327624:0:15847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833930.327650:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787833930.327722:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833930.331009:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341f47600 going to sleep for 11 seconds 00000100:00100000:2.0:1787833930.331743:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375690624 00000100:00100000:2.0:1787833930.331757:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375690624 00000100:00100000:2.0:1787833930.331882:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787833930.331894:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:15847:x1874679375690624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787833930.331913:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833930.331940:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775f8a expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.331976:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775f8a expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.331998:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775f8a expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.332151:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd2200, rc 0) 00000100:00100000:2.0:1787833930.332231:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375690624:12345-0@lo:101:mount.lustre.0 Request processed in 340us (4508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833930.332238:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787833930.332483:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623ea940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787833930.332506:0:15847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.332525:0:15847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787833930.333766:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787833930.337263:0:15847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787833930.338804:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787833930.339131:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787833930.339221:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787833930.339233:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787833930.340260:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833930.340682:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833930.340731:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.340802:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375690752 00000100:00100000:1.0:1787833930.340810:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375690752 00000100:00100000:1.0:1787833930.340872:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787833930.340883:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375690752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787833930.341449:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375690752:12345-0@lo:501:mount.lustre.0 Request processed in 565us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.341458:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787833930.342233:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833930.342288:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787833930.342684:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833930.342725:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833930.343198:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375690880 00000100:00100000:0.0:1787833930.343205:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375690880 00000100:00100000:0.0:1787833930.343262:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787833930.343274:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375690880:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787833930.344828:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375690880:12345-0@lo:503:mount.lustre.0 Request processed in 1549us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.344843:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787833930.344866:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375690880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787833930.345743:0:15847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787833930.345828:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787833930.345886:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833930.346830:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.347261:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375691008 00000100:00100000:1.0:1787833930.347270:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375691008 00000100:00100000:1.0:1787833930.347432:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787833930.347443:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375691008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787833930.347698:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375691008:12345-0@lo:502:mount.lustre.0 Request processed in 257us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.347706:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787833930.347759:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787833930.348136:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787833930.348194:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787833930.348246:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787833930.348300:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787833930.348786:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787833930.348849:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787833930.348879:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787833930.348911:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787833930.348955:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787833930.349776:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833930.349832:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.349912:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375691136 00000100:00100000:1.0:1787833930.349919:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375691136 00000100:00100000:1.0:1787833930.350122:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787833930.350133:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375691136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787833930.350813:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375691136:12345-0@lo:502:mount.lustre.0 Request processed in 681us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.350823:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787833930.351822:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787833930.351958:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787833930.351971:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787833930.353263:0:15852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833930.353275:0:15852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833930.353278:0:15852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787833930.353285:0:15852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b646dc8e000 00000020:00000080:0.0:1787833930.353287:0:15852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787833930.353294:0:15852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833930.353296:0:15852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833930.353298:0:15852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787833930.353300:0:15852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833930.353302:0:15852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833930.353303:0:15852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787833930.353306:0:15852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b646dc8e000 00000020:00000080:0.0:1787833930.353308:0:15852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787833930.353391:0:15852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833930.353395:0:15852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833930.353396:0:15852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787833930.353399:0:15852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787833930.353401:0:15852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833930.353403:0:15852:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787833930.353405:0:15852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b646dc8e000 00000020:00000080:0.0:1787833930.353408:0:15852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787833930.353441:0:15852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787833930.353445:0:15852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787833930.353446:0:15852:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787833930.353449:0:15852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787833930.354153:0:15847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787833930.354184:0:15847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787833930.354254:0:15847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.354267:0:15847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833930.354314:0:15847:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787833930.354318:0:15847:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b646dc8e000 10000000:01000000:2.0:1787833930.354321:0:15847:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b646dc8e000 10000000:01000000:2.0:1787833930.354326:0:15847:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787833930.354332:0:15847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b646dc8e000 from 1 10000000:01000000:2.0:1787833930.354360:0:15847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787833930.354398:0:15847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3000/0x2bdb54ee5e775f98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.354406:0:15847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3000/0x2bdb54ee5e775f98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.354416:0:15847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3000/0x2bdb54ee5e775f98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833930.354451:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787833930.354521:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833930.354575:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833930.355919:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375691264 00000100:00100000:0.0:1787833930.355931:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375691264 00000100:00100000:0.0:1787833930.355991:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787833930.356010:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375691264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787833930.356026:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833930.356042:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647751e000/0x2bdb54ee5e775f9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775f98 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833930.356067:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647751e000/0x2bdb54ee5e775f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775f98 expref: 19 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833930.356089:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647751e000/0x2bdb54ee5e775f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775f98 expref: 19 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833930.356099:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e000, rc 0) 00000100:00100000:0.0:1787833930.356166:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375691264:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833930.356175:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787833930.356204:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787833930.356222:0:15847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3000/0x2bdb54ee5e775f98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775f9f expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.356233:0:15847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3000/0x2bdb54ee5e775f98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775f9f expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787833930.358717:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787833930.359546:0:15847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787833930.360752:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787833930.360819:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787833930.360873:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787833930.360955:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787833930.360997:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787833930.361132:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787833930.361175:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787833930.361205:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787833930.361258:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787833930.361286:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787833930.361311:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787833930.361752:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787833930.361797:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787833930.361843:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787833930.361894:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787833930.361934:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787833930.361984:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787833930.362648:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787833930.362687:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787833930.362714:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787833930.362751:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787833930.362779:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787833930.362804:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787833930.362840:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787833930.362888:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787833930.362935:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787833930.362994:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787833930.363965:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787833930.364109:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787833930.364164:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787833930.364193:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787833930.364218:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787833930.364243:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787833930.364279:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787833930.364306:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787833930.364618:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787833930.364665:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787833930.364754:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787833930.364761:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787833930.364866:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833930.364936:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833930.366180:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.366693:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375691392 00000100:00100000:1.0:1787833930.366706:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375691392 00000100:00100000:2.0:1787833930.366855:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787833930.366868:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375691392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833930.368578:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375691392:12345-0@lo:501:mount.lustre.0 Request processed in 1650us (3579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833930.368593:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787833930.368689:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787833930.368748:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787833930.368804:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833930.368840:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6476f9c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.369124:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375691520 00000100:00100000:1.0:1787833930.369133:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375691520 00000100:00100000:1.0:1787833930.369182:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787833930.369192:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375691520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787833930.370192:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375691520:12345-0@lo:503:mount.lustre.0 Request processed in 997us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.370202:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787833930.371184:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787833930.376141:0:15847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787833930.376618:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787833930.376706:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833930.376758:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375691648 00000100:00100000:2.0:1787833930.376765:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375691648 00000100:00100000:2.0:1787833930.376809:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787833930.376820:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6481c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375691648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787833930.377044:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6481c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375691648:12345-0@lo:502:mount.lustre.0 Request processed in 225us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833930.377052:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787833930.378919:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833930.378959:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787833930.379698:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787833930.379767:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787833930.379801:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787833930.379841:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787833930.379872:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787833930.379913:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787833930.380124:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787833930.380158:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787833930.380225:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787833930.380606:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787833930.380650:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787833930.380707:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787833930.380740:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787833930.380774:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787833930.380821:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787833930.380868:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787833930.380902:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787833930.380946:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787833930.380977:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787833930.381008:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787833930.381053:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787833930.381087:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787833930.381119:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787833930.381159:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787833930.381189:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787833930.381219:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787833930.381623:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787833930.381659:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787833930.381685:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787833930.381723:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787833930.381754:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787833930.381806:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787833930.381842:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787833930.381888:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787833930.381923:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787833930.381970:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787833930.382005:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787833930.382038:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787833930.382084:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787833930.382120:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787833930.382173:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787833930.382323:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833930.382388:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375691776 00000100:00100000:2.0:1787833930.382391:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6451e13c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787833930.382395:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375691776 00000100:00100000:1.0:1787833930.382453:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787833930.382463:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644523c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375691776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787833930.382824:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644523c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375691776:12345-0@lo:502:mount.lustre.0 Request processed in 361us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.382832:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787833930.382840:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375691776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787833930.382919:0:15847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787833930.382930:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787833930.389202:0:15857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787833930.389221:0:15857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b6341b6b490) 00000020:00000080:1.0:1787833930.389245:0:15857:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787833930.389313:0:15857:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b646dc8e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787833930.389317:0:15857:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b646dc8e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787833930.389320:0:15857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b646dc8e000 3 00010000:00080000:1.0:1787833930.389411:0:15857:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6342809000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787833930.391821:0:15857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787833930.392099:0:15857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787833930.392134:0:15857:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787833930.392148:0:15857:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2bdb54ee5e775fad 00000100:00080000:1.0:1787833930.392160:0:15857:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787833930.392166:0:15857:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b6342809000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787833930.392205:0:15857:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6477405a40 x1874679375691904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787833930.392280:0:15857:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787833930.392318:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1874679375691904:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787833930.392331:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787833930.392335:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787833930.392337:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b645183a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787833930.392357:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:1.0:1787833930.392361:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787833930.392365:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b645183a000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787833930.392377:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6477404f00 x1874679375692160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787833930.392415:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833930.392429:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375692032:0@lo:400:kworker.0 00000100:00100000:1.0:1787833930.392457:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833930.392459:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375692160:0@lo:8:kworker.0 00000100:00100000:3.0:1787833930.392491:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833930.392491:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64774043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375692288:0@lo:400:kworker.0 00000100:00100000:1.0:1787833930.392514:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833930.392531:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833930.392533:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375691904 00000100:00100000:1.0:1787833930.392537:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64774061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375692416:0@lo:400:kworker.0 00000100:00100000:3.0:1787833930.392538:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375691904 00000100:00100000:1.0:1787833930.392556:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833930.392574:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375692288 00000100:00100000:3.0:1787833930.392577:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375692288 00000100:00100000:1.0:1787833930.392609:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375692032 00000100:00100000:1.0:1787833930.392612:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375692032 00000100:00100000:3.0:1787833930.392615:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375692416 00000100:00100000:3.0:1787833930.392617:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375692416 00000100:00100000:1.0:1787833930.392644:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375692160 00000100:00100000:1.0:1787833930.392648:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375692160 00000100:00100000:1.0:1787833930.392660:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833930.392669:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375692032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833930.392720:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375692032:12345-0@lo:400:kworker.0 Request processed in 51us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.392726:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833930.392739:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833930.392743:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3279:x1874679375692160:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787833930.392785:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3279:x1874679375692160:12345-0@lo:8:kworker.0 Request processed in 40us (297us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787833930.392791:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833930.392813:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787833930.392819:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375692288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833930.392850:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874679375692288:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.392865:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787833930.392880:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833930.392884:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1874679375691904:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787833930.392900:0:14446:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:1.0:1787833930.392927:0:14446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2bdb54ee5e775fb4 00000004:00100000:1.0:1787833930.392943:0:14446:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787833930.392971:0:14446:0:(import.c:65:import_set_state_nolock()) ffff9b634280c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833930.393001:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1874679375691904:12345-0@lo:38:llog_process_th.0 Request processed in 115us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833930.393008:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787833930.394717:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787833930.394727:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833930.394800:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375692032:0@lo:400:kworker.0 00010000:00080000:1.0:1787833930.394847:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64774043c0 x1874679375692288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833930.394859:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64774043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874679375692288:0@lo:400:kworker.0 00000100:00100000:1.0:1787833930.394899:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787833930.394906:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b645183a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787833930.394909:0:3279:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787833930.394913:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375692160:0@lo:8:kworker.0 00010000:00080000:1.0:1787833930.394942:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6477405a40 x1874679375691904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787833940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787833930.394951:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787833930.394959:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787833930.394973:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787833930.394979:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787833930.394983:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b6342809000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787833930.394989:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1874679375691904:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787833930.395262:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1787833930.396112:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833930.396126:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375692416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833930.396215:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375692416:12345-0@lo:400:kworker.0 Request processed in 94us (3657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833930.396222:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:3.0:1787833930.396268:0:15847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787833930.396302:0:15847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787833930.396318:0:15847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3000/0x2bdb54ee5e775f98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775f9f expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.396335:0:15847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3000/0x2bdb54ee5e775f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775f9f expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787833930.396526:0:15847:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787833930.396529:0:15847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833930.396530:0:15847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833930.396531:0:15847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833930.396532:0:15847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833930.396533:0:15847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833930.396535:0:15847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833930.396537:0:15847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833930.396538:0:15847:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787833930.396543:0:15847:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787833930.396545:0:15847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787833930.396546:0:15847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833930.396547:0:15847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833930.396548:0:15847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833930.396549:0:15847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833930.396551:0:15847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833930.396552:0:15847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833930.396553:0:15847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833930.396554:0:15847:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787833930.396587:0:15847:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787833930.396607:0:15847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375692544:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787833930.396651:0:15847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833930.396678:0:15847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6341f47f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787833930.397681:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375692544 00000100:00100000:2.0:1787833930.397690:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375692544 00000100:00100000:2.0:1787833930.397727:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787833930.397734:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644523f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:15847:x1874679375692544:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787833930.397759:0:14439:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787833930.397772:0:14439:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1787833930.402802:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b64774061c0 x1874679375692416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833930.402824:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64774061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375692416:0@lo:400:kworker.0 20000000:01000000:2.0:1787833930.427865:0:14439:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787833930.427912:0:14439:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787833930.428528:0:14460:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787833930.428533:0:14460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787833930.428554:0:14460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833930.428583:0:14460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e8e expref: 19 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833930.428591:0:14460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833930.428633:0:14460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e775e8e expref: 19 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833930.428882:0:14460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e8e expref: 19 pid: 14438 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833930.428899:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14460:1874679375692672:0@lo:104: 00000100:00100000:1.0:1787833930.428971:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833930.429019:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64528cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1787833930.429074:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375692672 00000100:00100000:2.0:1787833930.429082:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375692672 00000100:00100000:2.0:1787833930.429136:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833930.429145:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:14460:x1874679375692672:12345-0@lo:104: 00010000:00010000:2.0:1787833930.429158:0:14427:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429215:0:14427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833930.429220:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:14460:x1874679375692672:12345-0@lo:104: Request processed in 77us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833930.429227:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787833930.429253:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833930.429259:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429266:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198200 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:2.0:1787833930.429271:0:14433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429279:0:14433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787833930.429302:0:14433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787833930.429308:0:14433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787833930.429333:0:14433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429360:0:14433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787833930.429379:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429386:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462198200/0x2bdb54ee5e775e8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775e95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429401:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833930.429403:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833930.429404:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833930.429413:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3280:1874679375692800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833930.429440:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833930.429477:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375692800 00000100:00100000:2.0:1787833930.429480:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375692800 00010000:00010000:2.0:1787833930.429494:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e8e expref: 20 pid: 14438 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833930.429513:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833930.429529:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+20:3280:x1874679375692800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787833930.429538:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833930.429543:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e8e expref: 20 pid: 14438 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429566:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e8e expref: 20 pid: 14438 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429584:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429591:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787833930.429605:0:14429:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003698007s 00010000:00010000:2.0:1787833930.429609:0:14429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429616:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429623:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429630:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429635:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd7200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833930.429640:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429647:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429656:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833930.429672:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833930.429697:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+20:3280:x1874679375692800:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833930.429704:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787833930.429736:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3280:1874679375692800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833930.429909:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6442a2c400/0x2bdb54ee5e775e95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e775e8e expref: 19 pid: 14438 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833930.429920:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14460:1874679375692672:0@lo:104: 00010000:00010000:3.0:1787833930.429932:0:14460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.429950:0:14460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.429957:0:14460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833930.429963:0:14460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e775fbb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833930.437523:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644523f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:15847:x1874679375692544:12345-0@lo:253:mount.lustre.0 Request processed in 39772us (40854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833930.437539:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787833930.437675:0:15847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64623e8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:15847:1874679375692544:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787833930.437689:0:15847:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787833930.437691:0:15847:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787833930.437692:0:15847:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787833930.437693:0:15847:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787833930.437694:0:15847:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787833930.437695:0:15847:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787833930.437696:0:15847:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787833930.437697:0:15847:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787833930.437698:0:15847:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787833930.437699:0:15847:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787833930.437714:0:15847:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787833930.441101:0:15847:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833930.441212:0:15847:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833930.441391:0:15847:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833930.441531:0:15847:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787833930.441750:0:15847:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787833930.441902:0:15847:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787833930.442436:0:15847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787833930.493420:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787833930.506854:0:15847:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787833930.506865:0:15847:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787833930.506897:0:15847:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787833930.506946:0:15847:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787833930.506959:0:15847:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787833930.507005:0:15847:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:0.0:1787833931.456857:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787833931.456884:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787833931.521371:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787833931.523027:0:14441:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787833931.523034:0:14441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b6477609800 from 8 10000000:01000000:1.0:1787833931.523039:0:14441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787833931.523078:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647fcd7e00/0x2bdb54ee5e775fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.523090:0:14441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b647fcd7e00/0x2bdb54ee5e775fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.523101:0:14441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b647fcd7e00/0x2bdb54ee5e775fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833931.523125:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375692928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833931.523192:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833931.523253:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b644894ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833931.523276:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375692928 00000100:00100000:1.0:1787833931.523282:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375692928 00000100:00100000:1.0:1787833931.523334:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787833931.523361:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b644523e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:14441:x1874679375692928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833931.523376:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833931.523388:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647fcd7600/0x2bdb54ee5e775fc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e775fc2 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.523412:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647fcd7600/0x2bdb54ee5e775fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e775fc2 expref: 19 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.523421:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647fcd7600/0x2bdb54ee5e775fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775fc2 expref: 19 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.523430:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd7600, rc 0) 00000100:00100000:1.0:1787833931.523480:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b644523e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:14441:x1874679375692928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833931.523488:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787833931.523539:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375692928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833931.523564:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b647fcd7e00/0x2bdb54ee5e775fc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775fc9 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833931.523573:0:14441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b647fcd7e00/0x2bdb54ee5e775fc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e775fc9 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833931.523625:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375693056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787833931.523655:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833931.523686:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b644894ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833931.524103:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375693056 00000100:00100000:2.0:1787833931.524110:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375693056 00000100:00100000:2.0:1787833931.524146:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787833931.524153:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:14441:x1874679375693056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787833931.524170:0:14439:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787833931.524187:0:14439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787833931.524190:0:14439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787833931.524269:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:14441:x1874679375693056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833931.524276:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787833931.524308:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375693056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787833931.524388:0:14441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787833931.524396:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647fcd7e00/0x2bdb54ee5e775fc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775fc9 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833931.524406:0:14441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b647fcd7e00/0x2bdb54ee5e775fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e775fc9 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833932.542141:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833933.372756:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787833933.372784:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375693184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833933.372855:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833933.373217:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375693184 00000100:00100000:2.0:1787833933.373224:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375693184 00000100:00100000:2.0:1787833933.373283:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833933.373290:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375693184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833933.373328:0:15132:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787833933.374026:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833933.374086:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375693184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 793us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833933.374096:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787833933.375651:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787833933.375686:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375693184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787833933.564544:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833934.590049:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787833935.420637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787833935.420643:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787833935.420647:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b645183a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787833935.420660:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b645183a000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787833935.420682:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6479ef70c0 x1874679375693568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787833935.420746:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375693440:0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.420817:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833935.420879:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787833935.420885:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375693312:0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.420915:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833935.420937:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375693952:0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.420966:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833935.420997:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375693568:0@lo:8:kworker.0 00000100:00100000:2.0:1787833935.421021:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833935.421059:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375693696:0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.421083:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833935.421099:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833935.421104:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375693824:0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.421124:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833935.421152:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375693440 00000100:00100000:2.0:1787833935.421159:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375693440 00000100:00100000:2.0:1787833935.421206:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375693568 00000100:00100000:2.0:1787833935.421210:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375693568 00000100:00100000:2.0:1787833935.421223:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833935.421232:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375693440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.421282:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375693440:12345-0@lo:400:kworker.0 Request processed in 51us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.421289:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833935.421304:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787833935.421308:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3279:x1874679375693568:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787833935.421330:0:15131:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:2.0:1787833935.421377:0:15131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bdb54ee5e775fd0 00002000:00100000:2.0:1787833935.421392:0:15131:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b63413a0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113962 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787833935.421397:0:15131:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787833935.421400:0:15131:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787833935.421770:0:15131:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787833935.421795:0:15131:0:(import.c:65:import_set_state_nolock()) ffff9b63413a3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787833935.421835:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1874679375693568:12345-0@lo:8:kworker.0 Request processed in 525us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.421841:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787833935.421863:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375693312 00000100:00100000:2.0:1787833935.421872:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375693312 00000100:00100000:2.0:1787833935.421902:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787833935.421908:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64778ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3283:x1874679375693312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.421939:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64778ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3283:x1874679375693312:12345-0@lo:400:kworker.0 Request processed in 32us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.421945:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787833935.421971:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375693952 00000100:00100000:2.0:1787833935.421974:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375693952 00000100:00100000:2.0:1787833935.421994:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375693696 00000100:00100000:2.0:1787833935.421996:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375693696 00000100:00100000:2.0:1787833935.422007:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375693824 00000100:00100000:2.0:1787833935.422009:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375693824 00000100:00100000:2.0:1787833935.422022:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833935.422027:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375693952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.422054:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375693952:12345-0@lo:400:kworker.0 Request processed in 27us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.422060:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833935.422070:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833935.422075:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375693696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.422102:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375693696:12345-0@lo:400:kworker.0 Request processed in 26us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.422107:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833935.422117:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787833935.422122:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375693824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.422145:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1874679375693824:12345-0@lo:400:kworker.0 Request processed in 24us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.422151:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787833935.422182:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787833935.422186:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833935.422217:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375693312:0@lo:400:kworker.0 00010000:00080000:2.0:1787833935.422230:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6479ef4b40 x1874679375693952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833935.422240:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375693952:0@lo:400:kworker.0 00000100:00100000:2.0:1787833935.422253:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375693440:0@lo:400:kworker.0 00010000:00080000:2.0:1787833935.422284:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6479ef70c0 x1874679375693568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787833960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787833935.422294:0:3279:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787833935.422301:0:3279:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787833935.422306:0:3279:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787833935.422308:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9b645183a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787833935.422323:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787833935.422327:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1874679375693568:0@lo:8:kworker.0 00010000:00080000:2.0:1787833935.422374:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6479ef5680 x1874679375693824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833935.422382:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1874679375693824:0@lo:400:kworker.0 00010000:00080000:2.0:1787833935.422391:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6479ef5e00 x1874679375693696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787833951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787833935.422398:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375693696:0@lo:400:kworker.0 00000004:00080000:2.0:1787833935.422435:0:14469:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787833935.422451:0:14469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14469:1874679375694208:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787833935.422481:0:14469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833935.422495:0:14469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64468b59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833935.422508:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375694208 00000100:00100000:2.0:1787833935.422511:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375694208 00000100:00100000:2.0:1787833935.422549:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787833935.422555:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14469:x1874679375694208:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787833935.423591:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787833935.423609:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375694080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833935.423658:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787833935.423723:0:14468:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787833935.424078:0:14468:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414179736969ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787833935.424111:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375694080 00000100:00100000:0.0:1787833935.424116:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375694080 00000100:00100000:0.0:1787833935.424147:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787833935.424154:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874679375694080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787833935.424181:0:15133:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787833935.424222:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1874679375694080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833935.424229:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787833935.424482:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6479ef5e00 x1874679375694080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787833951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787833935.424496:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375694080:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787833935.425575:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787833935.426935:0:15131:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787833935.426944:0:15131:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787833935.426948:0:15131:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1787833935.433475:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.433487:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.433504:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.433508:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.433526:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.433545:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.433556:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.433564:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.433596:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787833935.434010:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.434017:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434025:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.434028:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.434033:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434042:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434050:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434057:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434073:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787833935.434493:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.434499:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434508:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.434533:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.434538:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434549:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434558:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434565:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434574:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787833935.434974:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.434981:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.434989:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.434992:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.434996:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.435006:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.435014:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.435028:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.435036:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787833935.435457:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.435463:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.435471:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.435474:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.435478:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.435487:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.435495:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.435502:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.435510:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1787833935.435640:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787833935.435650:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435660:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.435665:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435675:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435697:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435706:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099aab443/0x2bdb54ee5e775fd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435735:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787833935.435741:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435749:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3c00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.435761:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435768:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435779:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435786:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bc33389/0x2bdb54ee5e775fde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435798:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787833935.435801:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435806:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.435809:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435816:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435824:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435830:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081dc78f1/0x2bdb54ee5e775fe5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435849:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833935.435853:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435859:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.435862:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435869:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435879:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435887:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e775fec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435899:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833935.435902:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435908:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2a00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.435911:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435932:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435943:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.435951:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c3c0a46/0x2bdb54ee5e775ff3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.436624:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.436629:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.436632:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.436639:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787833935.437161:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.437170:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.437190:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.437196:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.437202:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.437215:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.437224:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.437232:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.437291:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787833935.437742:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.437749:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.437757:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.437760:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.437765:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.437775:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.437793:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.437799:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437846:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787833935.437853:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437861:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833935.437865:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437874:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437891:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437908:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec343655/0x2bdb54ee5e775ffa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437925:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833935.437929:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437936:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3a00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833935.437940:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437948:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437958:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.437965:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.437966:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.437968:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.438030:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787833935.438035:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776001 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833935.438437:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.438443:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.438452:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.438456:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.438460:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.438469:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.438477:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.438495:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.438551:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833935.438557:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.438564:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833935.438573:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.438582:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.438593:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.438602:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.438603:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.438605:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.438669:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787833935.438674:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e776008 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833935.439050:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.439056:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.439065:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.439068:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.439073:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.439081:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.439089:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.439097:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439140:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833935.439145:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439151:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83a00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833935.439155:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439163:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439174:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439182:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.439189:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.439190:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.439248:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787833935.439253:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e77600f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833935.439681:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.439687:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.439695:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.439698:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.439701:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.439709:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.439716:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.439723:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439774:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833935.439779:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439785:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833935.439788:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439796:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439807:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.439815:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.439816:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.439818:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.439873:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787833935.439878:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e776016 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787833935.440288:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.440293:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.440302:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.440305:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.440309:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.440318:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.440326:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.440333:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.440391:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787833935.440398:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.440405:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:0.0:1787833935.440409:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.440418:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.440436:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.440444:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.440446:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833935.440448:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.440502:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787833935.440507:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e77601d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833935.440569:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.442712:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.442724:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442740:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.442745:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.442752:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442765:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442776:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442793:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442812:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833935.442826:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833935.442832:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442839:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2da00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.442843:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442854:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442870:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442877:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7931a91/0x2bdb54ee5e776024 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.442895:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.442897:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.442899:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.447047:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.447073:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447090:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.447095:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.447101:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447116:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447126:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447133:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447153:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833935.447167:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833935.447173:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447181:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.447185:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447194:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447784:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447795:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c966f84d/0x2bdb54ee5e77602b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.447814:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.447817:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.447819:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.448489:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.448496:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.448507:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.448511:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.448529:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.448541:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.448549:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.448556:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.448588:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833935.448614:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833935.448624:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.448646:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2ce00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833935.448651:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.448661:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.448676:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.448683:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2901ed/0x2bdb54ee5e776032 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.448703:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.448705:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.448709:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.449059:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.449066:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.449075:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.449078:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.449082:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.449091:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.449099:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.449106:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.449124:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833935.449148:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833935.449154:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.449162:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833935.449166:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.449174:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.449194:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.449201:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbccb0e4/0x2bdb54ee5e776039 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.449216:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.449219:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.449221:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.450844:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.450855:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.450867:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.450880:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.450886:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.450897:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.450905:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.450912:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.450929:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833935.450952:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833935.450961:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.450970:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2cc00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833935.450974:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.450983:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.450997:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.451004:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006815ca04/0x2bdb54ee5e776040 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.451034:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.451037:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.451039:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.453738:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.453749:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453765:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.453770:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.453776:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453790:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453800:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453814:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453835:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833935.453849:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833935.453854:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453860:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.453864:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453873:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453888:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453895:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d80c145/0x2bdb54ee5e776047 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.453915:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.453916:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.453918:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.455621:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.455639:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.455654:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.455660:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.455664:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.455675:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.455685:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.455692:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.455719:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787833935.455785:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833935.455796:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.455807:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833935.455812:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.455822:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.455843:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.455863:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012ec4573/0x2bdb54ee5e77604e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833935.455884:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833935.455887:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833935.455890:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.456301:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.456307:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.456316:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.456319:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.456323:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.456332:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.456375:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.456615:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.456642:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787833935.457171:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.457178:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457186:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.457189:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.457193:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457203:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457210:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457292:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457330:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787833935.457367:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833935.457374:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457509:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2c800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.457523:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457533:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457548:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457555:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a18bf424/0x2bdb54ee5e776055 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457570:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833935.457573:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457579:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2de00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.457582:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457603:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457613:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457620:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b7b96dd/0x2bdb54ee5e77605c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.457632:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.457634:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.457636:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.458153:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.458160:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.458169:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.458172:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.458176:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.458186:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.458194:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.458211:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.458752:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833935.458795:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833935.458804:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.458814:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2dc00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833935.458819:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.458829:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.458846:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.458855:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046235683/0x2bdb54ee5e776063 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.458876:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.458879:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.458880:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833935.458921:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.459733:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.459740:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.459752:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.459756:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.459761:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.459771:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.459780:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.459787:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.460102:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787833935.460202:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787833935.460210:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.460233:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833935.460238:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.460246:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.460260:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.460269:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076e47ca7/0x2bdb54ee5e77606a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.460286:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.460288:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787833935.460290:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787833935.461113:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787833935.461121:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461140:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1787833935.461146:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833935.461151:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461162:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461171:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461178:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461198:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833935.461208:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833935.461633:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461645:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd3a00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.461649:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461658:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461685:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461693:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776071 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.461712:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.461714:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.461716:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787833935.461862:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.461870:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.461880:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.461883:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.461888:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.461898:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.461912:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.461919:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.461939:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833935.461962:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833935.462025:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462036:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.462040:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462049:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462061:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462069:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000826e7da6/0x2bdb54ee5e776078 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462098:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.462101:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.462104:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787833935.462381:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.462387:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462396:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.462400:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.462404:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462414:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462422:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462429:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462454:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787833935.462551:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833935.462557:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462567:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82800 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.462571:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462579:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462591:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462599:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3b3628f/0x2bdb54ee5e77607f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.462621:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.462623:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.462627:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787833935.462819:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.462825:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462834:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.462837:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.462841:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462850:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462859:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462866:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.462889:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787833935.463259:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.463264:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463272:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.463280:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.463285:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463295:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463304:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463311:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463324:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787833935.463769:0:15131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787833935.463775:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463782:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1787833935.463785:0:15131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833935.463788:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463794:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463799:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463809:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833935.463814:0:15131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:2.0:1787833935.463992:0:15131:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1787833935.464077:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14469:x1874679375694208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 41519us (41592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833935.464085:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787833935.464559:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787833935.464566:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464585:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83a00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.464587:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464594:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464604:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464608:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b8e24da/0x2bdb54ee5e776086 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464619:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787833935.464622:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464625:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.464627:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464632:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464636:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464645:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004401c5a7/0x2bdb54ee5e77608d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464652:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833935.464653:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464657:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82e00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833935.464659:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464664:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464669:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464673:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e776094 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833935.464682:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.464683:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.464685:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833935.464691:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833935.464816:0:14469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14469:1874679375694208:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787833935.464828:0:14469:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787833935.464866:0:14469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14469:1874679375694336:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787833935.464899:0:14469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833935.464965:0:14469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64468b59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833935.464986:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375694336 00000100:00100000:2.0:1787833935.464992:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375694336 00000100:00100000:3.0:1787833935.465048:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787833935.465057:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14469:x1874679375694336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787833935.465104:0:15130:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:0.0:1787833935.465439:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787833935.471573:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14469:x1874679375694336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6510us (6666us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787833935.471587:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833935.471716:0:14469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6479ef5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14469:1874679375694336:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787833935.471734:0:14469:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1787833935.612463:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787833935.996969:0:14477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1787833936.017818:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787833936.017846:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:02000400:2.0:1787833936.551898:0:16201:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787833936.640002:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833937.661466:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833938.498050:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787833938.498074:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375694464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787833938.498144:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833938.498232:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375694464 00000100:00100000:1.0:1787833938.498239:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375694464 00000100:00100000:1.0:1787833938.498296:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833938.498304:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375694464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787833938.498362:0:15133:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833938.498404:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1874679375694464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833938.498411:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787833938.498430:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833938.498581:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375694464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787833938.705096:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833939.018468:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833939.018663:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367310592 00000100:00100000:1.0:1787833939.018674:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367310592 00000100:00100000:1.0:1787833939.018732:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:1.0:1787833939.018740:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2343:x1874679367310592:12345-192.168.202.15@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787833939.018788:0:14438:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 54ea64ce-9f56-4ecd-b929-99c45af8c173@192.168.202.15@tcp t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:1.0:1787833939.018817:0:14438:0:(genops.c:1385:class_connect()) connect: client 54ea64ce-9f56-4ecd-b929-99c45af8c173, cookie 0x2bdb54ee5e77609b 00000100:00080000:1.0:1787833939.018983:0:14438:0:(import.c:65:import_set_state_nolock()) ffff9b634280f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833939.019075:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+5:2343:x1874679367310592:12345-192.168.202.15@tcp:250:mount.lustre.0 Request processed in 333us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.019084:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:2.0:1787833939.034236:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833939.034471:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367310720 00000100:00100000:0.0:1787833939.034491:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367310720 00000100:00100000:0.0:1787833939.034555:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:0.0:1787833939.034566:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+5:13746:x1874679367310720:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787833939.034583:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833939.034602:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647751ea00/0x2bdb54ee5e7760a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e47 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.034632:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647751ea00/0x2bdb54ee5e7760a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e47 expref: 6 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.034644:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647751ea00/0x2bdb54ee5e7760a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e47 expref: 6 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833939.034653:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751ea00, rc 0) 00000100:00100000:0.0:1787833939.034724:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+6:13746:x1874679367310720:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 159us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.034731:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:0.0:1787833939.045937:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833939.046146:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367310848 00000100:00100000:2.0:1787833939.046169:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367310848 00000100:00100000:2.0:1787833939.046228:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:2.0:1787833939.046238:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+6:13746:x1874679367310848:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787833939.057187:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+6:13746:x1874679367310848:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 10938us (11253us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787833939.057203:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:2.0:1787833939.066824:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833939.067052:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367310976 00000100:00100000:1.0:1787833939.067063:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367310976 00000100:00100000:1.0:1787833939.067175:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:1.0:1787833939.067186:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+6:13746:x1874679367310976:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787833939.067204:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833939.067224:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647fcd7000/0x2bdb54ee5e7760a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e4e expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.067253:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647fcd7000/0x2bdb54ee5e7760a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e4e expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.067264:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647fcd7000/0x2bdb54ee5e7760a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e4e expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.067292:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd7000, rc 0) 00000100:00100000:1.0:1787833939.067422:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+7:13746:x1874679367310976:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 237us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.067429:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:2.0:1787833939.075822:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833939.076013:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367311104 00000100:00100000:3.0:1787833939.076022:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367311104 00000100:00100000:3.0:1787833939.076115:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:3.0:1787833939.076127:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+7:13746:x1874679367311104:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787833939.076606:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+8:13746:x1874679367311104:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 479us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833939.076616:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:2.0:1787833939.082249:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833939.082456:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367311232 00000100:00100000:1.0:1787833939.082466:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367311232 00000100:00100000:1.0:1787833939.082535:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:1.0:1787833939.082557:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+8:13746:x1874679367311232:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787833939.083123:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+8:13746:x1874679367311232:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 566us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.083133:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:2.0:1787833939.103871:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833939.104013:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367311360 00000100:00100000:3.0:1787833939.104024:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367311360 00000100:00100000:3.0:1787833939.104085:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:3.0:1787833939.104096:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+8:13765:x1874679367311360:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787833939.104535:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+8:13765:x1874679367311360:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 440us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833939.104557:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:3.0:1787833939.140967:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833939.141207:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367311488 00000100:00100000:0.0:1787833939.141218:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367311488 00000100:00100000:0.0:1787833939.141284:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:0.0:1787833939.141295:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+8:13765:x1874679367311488:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787833939.141667:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+8:13765:x1874679367311488:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 373us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.141676:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:2.0:1787833939.151991:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833939.152102:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367311616 00000100:00100000:1.0:1787833939.152112:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367311616 00000100:00100000:1.0:1787833939.152171:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:1.0:1787833939.152182:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+8:13746:x1874679367311616:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787833939.152203:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833939.152224:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647fcd7800/0x2bdb54ee5e7760b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e78 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.152253:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647fcd7800/0x2bdb54ee5e7760b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e78 expref: 9 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.152265:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647fcd7800/0x2bdb54ee5e7760b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e78 expref: 9 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.152275:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd7800, rc 0) 00000100:00100000:1.0:1787833939.152336:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+9:13746:x1874679367311616:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 156us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.152383:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:2.0:1787833939.161644:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833939.161845:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367311744 00000100:00100000:3.0:1787833939.161855:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367311744 00000100:00100000:3.0:1787833939.162015:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:3.0:1787833939.162026:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+9:13746:x1874679367311744:12345-192.168.202.15@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787833939.162056:0:14437:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787833939.162082:0:14437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787833939.162086:0:14437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787833939.162090:0:14437:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787833939.162092:0:14437:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787833939.167145:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+9:13746:x1874679367311744:12345-192.168.202.15@tcp:256:mount.lustre.0 Request processed in 5109us (5498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.167161:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:2.0:1787833939.171720:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833939.171896:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367311872 00000100:00100000:1.0:1787833939.171909:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367311872 00000100:00100000:1.0:1787833939.171969:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:1.0:1787833939.171980:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+9:13746:x1874679367311872:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787833939.171999:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833939.172035:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3e7f expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.172066:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e7f expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.172078:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e7f expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833939.172088:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6800, rc 0) 00000100:00100000:1.0:1787833939.172153:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13746:x1874679367311872:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 175us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.172160:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:2.0:1787833939.177960:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833939.178077:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367312000 00000100:00100000:1.0:1787833939.178087:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367312000 00000100:00100000:1.0:1787833939.178136:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:1.0:1787833939.178145:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13746:x1874679367312000:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787833939.178797:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13746:x1874679367312000:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 649us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.178809:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:3.0:1787833939.181128:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833939.181501:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367312128 00000100:00100000:0.0:1787833939.181511:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367312128 00000100:00100000:0.0:1787833939.181571:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:0.0:1787833939.181581:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13746:x1874679367312128:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787833939.181986:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13746:x1874679367312128:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 405us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.181995:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:0.0:1787833939.185912:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833939.186547:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367312256 00000100:00100000:1.0:1787833939.186559:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367312256 00000100:00100000:1.0:1787833939.186607:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:1.0:1787833939.186617:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13769:x1874679367312256:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787833939.187199:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13769:x1874679367312256:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 581us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.187209:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:1.0:1787833939.211677:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833939.211821:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367312384 00000100:00100000:2.0:1787833939.211833:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367312384 00000100:00100000:2.0:1787833939.211898:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:2.0:1787833939.211908:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13769:x1874679367312384:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833939.212174:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13769:x1874679367312384:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 266us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.212182:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:2.0:1787833939.226109:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833939.227858:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367312512 00000100:00100000:3.0:1787833939.227873:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367312512 00000100:00100000:3.0:1787833939.227946:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787833939.227955:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2343:x1874679367312512:12345-192.168.202.15@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787833939.227987:0:14445:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 4865fa16-b0dc-4920-8df4-908aff1ec664@192.168.202.15@tcp t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:3.0:1787833939.228039:0:14445:0:(genops.c:1385:class_connect()) connect: client 4865fa16-b0dc-4920-8df4-908aff1ec664, cookie 0x2bdb54ee5e7760be 00000004:00100000:3.0:1787833939.228072:0:14445:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:3.0:1787833939.228079:0:14445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787833939.285029:0:14445:0:(import.c:65:import_set_state_nolock()) ffff9b6468da3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787833939.285121:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+6:2343:x1874679367312512:12345-192.168.202.15@tcp:38:mount.lustre.0 Request processed in 57165us (59021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.285134:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787833939.300057:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833939.300097:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833939.300238:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367312768 00000100:00100000:2.0:1787833939.300249:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367312768 00000100:00100000:2.0:1787833939.300318:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367312640 00000100:00100000:2.0:1787833939.300322:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367312640 00000100:00100000:2.0:1787833939.300371:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787833939.300381:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+7:13746:x1874679367312768:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787833939.300430:0:14446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787833939.300542:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+7:13746:x1874679367312768:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 162us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.300551:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787833939.300581:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787833939.300587:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+6:0:x1874679367312640:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787833939.300598:0:14446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787833939.300623:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+6:0:x1874679367312640:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 36us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.300631:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00080000:1.0:1787833939.300997:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833939.304215:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833939.304397:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367312896 00000100:00100000:0.0:1787833939.304436:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367312896 00000100:00100000:0.0:1787833939.304520:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787833939.304531:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+6:13746:x1874679367312896:12345-192.168.202.15@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787833939.304764:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+6:13746:x1874679367312896:12345-192.168.202.15@tcp:40:mount.lustre.0 Request processed in 233us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.304773:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787833939.312774:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833939.313063:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367313024 00000100:00100000:0.0:1787833939.313075:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367313024 00000100:00100000:0.0:1787833939.313137:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787833939.313146:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2343:x1874679367313024:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787833939.313181:0:15131:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 4865fa16-b0dc-4920-8df4-908aff1ec664@192.168.202.15@tcp t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:0.0:1787833939.313216:0:15131:0:(genops.c:1385:class_connect()) connect: client 4865fa16-b0dc-4920-8df4-908aff1ec664, cookie 0x2bdb54ee5e7760c5 00002000:00100000:0.0:1787833939.313231:0:15131:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4865fa16-b0dc-4920-8df4-908aff1ec664/ffff9b6468da5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787833939.313244:0:15131:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1787833939.313844:0:15131:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787833939.313886:0:15131:0:(import.c:65:import_set_state_nolock()) ffff9b634280e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787833939.313963:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+6:2343:x1874679367313024:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 816us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833939.313972:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787833939.320903:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833939.320950:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833939.321032:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367313152 00000100:00100000:3.0:1787833939.321042:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367313152 00000100:00100000:3.0:1787833939.321091:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787833939.321100:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1874679367313152:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787833939.321145:0:15130:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 4865fa16-b0dc-4920-8df4-908aff1ec664@192.168.202.15@tcp t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:3.0:1787833939.321192:0:15130:0:(genops.c:1385:class_connect()) connect: client 4865fa16-b0dc-4920-8df4-908aff1ec664, cookie 0x2bdb54ee5e7760cc 00002000:00100000:3.0:1787833939.321205:0:15130:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4865fa16-b0dc-4920-8df4-908aff1ec664/ffff9b6341205000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787833939.321227:0:15130:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1787833939.321647:0:15130:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787833939.321685:0:15130:0:(import.c:65:import_set_state_nolock()) ffff9b6341207000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833939.321761:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+6:2343:x1874679367313152:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 661us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833939.321771:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787833939.321958:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367313280 00000100:00100000:2.0:1787833939.321963:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367313280 00000100:00100000:2.0:1787833939.322000:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787833939.322008:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+6:13746:x1874679367313280:12345-192.168.202.15@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787833939.323535:0:14447:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1463us 00000004:00200000:0.0:1787833939.354952:0:14447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787833939.355148:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+6:13746:x1874679367313280:12345-192.168.202.15@tcp:33:mount.lustre.0 Request processed in 33134us (34191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833939.355164:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:0.0:1787833939.662090:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833939.662336:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367313408 00000100:00100000:3.0:1787833939.662497:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367313408 00000100:00100000:2.0:1787833939.662777:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787833939.662800:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+6:13790:x1874679367313408:12345-192.168.202.15@tcp:101:mkdir.0 00010000:00010000:2.0:1787833939.662830:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833939.662907:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e7760d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ea9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.662997:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82000/0x2bdb54ee5e7760da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.663012:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82000/0x2bdb54ee5e7760da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.663036:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82000/0x2bdb54ee5e7760da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833939.663276:0:14444:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787833939.663281:0:14444:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787833939.663406:0:14444:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82000/0x2bdb54ee5e7760da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.663452:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e7760d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ea9 expref: 8 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.663470:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82000/0x2bdb54ee5e7760da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ea9 expref: 7 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833939.663489:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:2.0:1787833939.663492:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787833939.663496:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c82000, rc 0) 00000100:00100000:2.0:1787833939.663574:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+7:13790:x1874679367313408:12345-192.168.202.15@tcp:101:mkdir.0 Request processed in 787us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833939.663581:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00010000:00010000:3.0:1787833939.708813:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833940.543546:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787833940.543571:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460345a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375694592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833940.543616:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375694848:0@lo:400:kworker.0 00000100:00100000:1.0:1787833940.543648:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833940.543648:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833940.543692:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3282:1874679375694720:0@lo:400:kworker.0 00000100:00100000:0.0:1787833940.543721:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64774043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375694976:0@lo:400:kworker.0 00000100:00100000:2.0:1787833940.543727:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833940.543751:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375694720 00000100:00100000:2.0:1787833940.543753:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375695232:0@lo:400:kworker.0 00000100:00100000:0.0:1787833940.543758:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375694720 00000100:00100000:2.0:1787833940.543775:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833940.543802:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787833940.543811:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3282:x1874679375694720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833940.543819:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375695232 00000100:00100000:2.0:1787833940.543822:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375695232 00000100:00100000:0.0:1787833940.543873:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3282:x1874679375694720:12345-0@lo:400:kworker.0 Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833940.543881:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787833940.543893:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375695104:0@lo:400:kworker.0 00000100:00100000:3.0:1787833940.543921:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833940.543929:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3282:1874679375694720:0@lo:400:kworker.0 00000100:00100000:1.0:1787833940.544629:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375695360:0@lo:400:kworker.0 00000100:00100000:1.0:1787833940.544672:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375694592 00000100:00100000:1.0:1787833940.544676:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375694592 00000100:00100000:1.0:1787833940.544794:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833940.544802:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f9383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375694592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787833940.544820:0:15133:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833940.544868:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f9383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375694592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833940.544875:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787833940.544897:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375694848 00000100:00100000:1.0:1787833940.544901:0:15128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375694848 00000100:00100000:1.0:1787833940.544931:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787833940.544938:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375694848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833940.544975:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375694848:12345-0@lo:400:kworker.0 Request processed in 38us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833940.544992:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787833940.545011:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787833940.545015:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833940.545018:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833940.545030:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833940.545061:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787833940.545086:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460345a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375694592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833940.545110:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375694976 00000100:00100000:1.0:1787833940.545114:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375694976 00000100:00100000:1.0:1787833940.545135:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833940.545141:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477406580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375694976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833940.545177:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477406580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375694976:12345-0@lo:400:kworker.0 Request processed in 36us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833940.545182:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787833940.545207:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64774043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375694976:0@lo:400:kworker.0 00000100:00100000:2.0:1787833940.545499:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375695104 00000100:00100000:2.0:1787833940.545505:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375695104 00000100:00100000:1.0:1787833940.545556:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833940.545636:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375694848:0@lo:400:kworker.0 00000100:00100000:3.0:1787833940.545675:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375695360 00000100:00100000:3.0:1787833940.545679:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375695360 00000100:00100000:3.0:1787833940.545710:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787833940.545718:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375695232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833940.545762:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375695232:12345-0@lo:400:kworker.0 Request processed in 46us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833940.545769:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787833940.545782:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787833940.545787:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375695104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833940.545820:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375695104:12345-0@lo:400:kworker.0 Request processed in 33us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833940.545825:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787833940.545843:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787833940.545861:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64774043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375695360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833940.545895:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64774043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375695360:12345-0@lo:400:kworker.0 Request processed in 35us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833940.545901:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787833940.545929:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375695104:0@lo:400:kworker.0 00000100:00080000:3.0:1787833940.545958:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833940.546057:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375695360:0@lo:400:kworker.0 00000100:00100000:0.0:1787833940.550915:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375695232:0@lo:400:kworker.0 00010000:00010000:3.0:1787833940.734071:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787833941.158939:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4865fa16-b0dc-4920-8df4-908aff1ec664 00000001:00100000:0.0:1787833941.648877:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4865fa16-b0dc-4920-8df4-908aff1ec664 00010000:00010000:3.0:1787833941.756678:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833941.987469:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833941.987607:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367313536 00000100:00100000:3.0:1787833941.987621:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367313536 00000100:00100000:3.0:1787833941.987724:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787833941.987738:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+7:13843:x1874679367313536:12345-192.168.202.15@tcp:41:lfs.0 00000004:00000024:3.0:1787833941.987804:0:14444:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787833941.987911:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+7:13843:x1874679367313536:12345-192.168.202.15@tcp:41:lfs.0 Request processed in 177us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833941.987920:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00080000:1.0:1787833941.988780:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833941.996425:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833941.996594:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367313664 00000100:00100000:1.0:1787833941.996608:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367313664 00000100:00100000:1.0:1787833941.996707:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:1.0:1787833941.996718:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4865fa16-b0dc-4920-8df4-908aff1ec664+5:13843:x1874679367313664:12345-192.168.202.15@tcp:13:lfs.0 00002000:00000024:1.0:1787833941.996770:0:15133:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833941.996912:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4865fa16-b0dc-4920-8df4-908aff1ec664+5:13843:x1874679367313664:12345-192.168.202.15@tcp:13:lfs.0 Request processed in 195us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833941.996921:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00080000:3.0:1787833941.998073:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787833942.009495:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833942.009734:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367313792 00000100:00100000:1.0:1787833942.009748:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367313792 00000100:00100000:1.0:1787833942.009844:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:1.0:1787833942.009857:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4865fa16-b0dc-4920-8df4-908aff1ec664+5:13843:x1874679367313792:12345-192.168.202.15@tcp:13:lfs.0 00002000:00000024:1.0:1787833942.009913:0:15133:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787833942.010680:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4865fa16-b0dc-4920-8df4-908aff1ec664+5:13843:x1874679367313792:12345-192.168.202.15@tcp:13:lfs.0 Request processed in 818us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833942.010692:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00080000:3.0:1787833942.011672:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787833942.265403:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833942.265615:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367313920 00000100:00100000:1.0:1787833942.265629:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367313920 00000100:00100000:1.0:1787833942.265710:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:1.0:1787833942.265721:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+10:13874:x1874679367313920:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787833942.265747:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833942.265772:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647fcd6400/0x2bdb54ee5e7760e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3eb0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833942.265809:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647fcd6400/0x2bdb54ee5e7760e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3eb0 expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833942.265822:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647fcd6400/0x2bdb54ee5e7760e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3eb0 expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833942.265834:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6400, rc 0) 00000100:00100000:1.0:1787833942.265927:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f8ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13874:x1874679367313920:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 207us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833942.265957:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787833942.270951:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833942.271061:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367314048 00000100:00100000:0.0:1787833942.271071:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367314048 00000100:00100000:0.0:1787833942.271147:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:0.0:1787833942.271157:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13874:x1874679367314048:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787833942.271647:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13874:x1874679367314048:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 491us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.271654:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:2.0:1787833942.278239:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833942.279563:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367314176 00000100:00100000:0.0:1787833942.279579:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367314176 00000100:00100000:0.0:1787833942.279668:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:0.0:1787833942.279681:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13874:x1874679367314176:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787833942.280076:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13874:x1874679367314176:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 396us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.280084:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:2.0:1787833942.301158:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833942.301462:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367314304 00000100:00100000:1.0:1787833942.301473:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367314304 00000100:00100000:1.0:1787833942.301541:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:1.0:1787833942.301552:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13881:x1874679367314304:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787833942.301846:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13881:x1874679367314304:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 295us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833942.302004:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:3.0:1787833942.358287:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833942.360713:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367314432 00000100:00100000:2.0:1787833942.360731:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367314432 00000100:00100000:2.0:1787833942.360807:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:2.0:1787833942.360829:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13881:x1874679367314432:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833942.361742:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13881:x1874679367314432:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 921us (3460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833942.361752:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:2.0:1787833942.378152:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833942.379148:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367314560 00000100:00100000:0.0:1787833942.379159:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367314560 00000100:00100000:0.0:1787833942.379239:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:0.0:1787833942.379249:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13874:x1874679367314560:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787833942.379279:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833942.379298:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647751e400/0x2bdb54ee5e7760e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3eda expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833942.379326:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647751e400/0x2bdb54ee5e7760e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3eda expref: 12 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833942.379377:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647751e400/0x2bdb54ee5e7760e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3eda expref: 12 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833942.379388:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e400, rc 0) 00000100:00100000:0.0:1787833942.379464:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13874:x1874679367314560:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 217us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.379472:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:0.0:1787833942.398030:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833942.398154:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367314688 00000100:00100000:2.0:1787833942.398164:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367314688 00000100:00100000:2.0:1787833942.398223:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:2.0:1787833942.398233:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13874:x1874679367314688:12345-192.168.202.15@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787833942.398261:0:14438:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787833942.398296:0:14438:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787833942.398300:0:14438:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787833942.398304:0:14438:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787833942.398306:0:14438:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787833942.405617:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13874:x1874679367314688:12345-192.168.202.15@tcp:256:mount.lustre.0 Request processed in 7371us (7584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833942.405635:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:0.0:1787833942.410764:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833942.411004:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367314816 00000100:00100000:2.0:1787833942.411017:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367314816 00000100:00100000:2.0:1787833942.411076:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:2.0:1787833942.411087:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13874:x1874679367314816:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787833942.411104:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833942.411134:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3ee1 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833942.411164:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ee1 expref: 13 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833942.411176:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ee1 expref: 13 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833942.411186:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c82e00, rc 0) 00000100:00100000:2.0:1787833942.411251:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13874:x1874679367314816:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 165us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833942.411258:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:0.0:1787833942.415291:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833942.415399:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367314944 00000100:00100000:2.0:1787833942.415411:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367314944 00000100:00100000:2.0:1787833942.415741:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:2.0:1787833942.415753:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13874:x1874679367314944:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787833942.416223:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13874:x1874679367314944:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 471us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833942.416233:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:3.0:1787833942.420560:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833942.420936:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367315072 00000100:00100000:1.0:1787833942.420947:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367315072 00000100:00100000:1.0:1787833942.421060:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:1.0:1787833942.421073:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13874:x1874679367315072:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787833942.421324:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13874:x1874679367315072:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 253us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833942.421332:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:0.0:1787833942.424252:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833942.424715:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367315200 00000100:00100000:2.0:1787833942.424726:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367315200 00000100:00100000:2.0:1787833942.424782:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:2.0:1787833942.424793:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13884:x1874679367315200:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787833942.425255:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13884:x1874679367315200:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 462us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833942.425264:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:2.0:1787833942.444384:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833942.444513:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367315328 00000100:00100000:1.0:1787833942.444525:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367315328 00000100:00100000:1.0:1787833942.444577:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:1.0:1787833942.444587:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13884:x1874679367315328:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787833942.444864:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13884:x1874679367315328:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 277us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833942.444872:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:3.0:1787833942.460113:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833942.460162:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833942.460201:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833942.460233:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833942.460263:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367315584 00000100:00100000:3.0:1787833942.460285:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367315584 00000100:00100000:3.0:1787833942.460381:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367315456 00000100:00100000:3.0:1787833942.460385:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367315456 00000100:00100000:3.0:1787833942.460402:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787833942.460531:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367315840 00000100:00100000:0.0:1787833942.460536:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367315840 00000100:00100000:0.0:1787833942.460568:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367315712 00000100:00100000:0.0:1787833942.460571:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367315712 00000100:00100000:0.0:1787833942.460586:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787833942.460593:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2345:x1874679367315840:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833942.460669:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2345:x1874679367315840:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 76us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.460688:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787833942.460704:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787833942.460710:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2345:x1874679367315712:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833942.460737:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2345:x1874679367315712:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.460743:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787833942.461257:0:14445:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787833942.461268:0:14445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787833942.461401:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787833942.461408:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2343:x1874679367315456:12345-192.168.202.15@tcp:38:mount.lustre.0 00000100:00100000:3.0:1787833942.462050:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+7:2345:x1874679367315584:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833942.462123:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+7:2345:x1874679367315584:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 1712us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833942.462131:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00010000:00080000:0.0:1787833942.463219:0:14445:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from a4b79920-a7bc-4762-befe-a82a11d15d6c@192.168.202.15@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:0.0:1787833942.463267:0:14445:0:(genops.c:1385:class_connect()) connect: client a4b79920-a7bc-4762-befe-a82a11d15d6c, cookie 0x2bdb54ee5e7760f6 00000004:00100000:0.0:1787833942.463302:0:14445:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1787833942.467959:0:14445:0:(import.c:65:import_set_state_nolock()) ffff9b6341fcb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787833942.468055:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2343:x1874679367315456:12345-192.168.202.15@tcp:38:mount.lustre.0 Request processed in 6644us (7818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833942.468069:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787833942.473124:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833942.473165:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833942.475698:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367316096 00000100:00100000:1.0:1787833942.475715:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367316096 00000100:00100000:1.0:1787833942.475898:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367315968 00000100:00100000:1.0:1787833942.475902:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367315968 00000100:00100000:1.0:1787833942.475938:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787833942.475948:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+7:13874:x1874679367316096:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787833942.476007:0:16323:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787833942.476103:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+7:13874:x1874679367316096:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 156us (2990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833942.476112:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787833942.476129:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787833942.476136:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:0:x1874679367315968:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787833942.476147:0:16323:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787833942.476170:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:0:x1874679367315968:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 34us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833942.476176:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787833942.479039:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833942.479133:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367316224 00000100:00100000:3.0:1787833942.479144:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367316224 00000100:00100000:3.0:1787833942.479202:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787833942.479212:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:13874:x1874679367316224:12345-192.168.202.15@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787833942.479306:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:13874:x1874679367316224:12345-192.168.202.15@tcp:40:mount.lustre.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833942.479313:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00080000:2.0:1787833942.481243:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787833942.482741:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833942.482785:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833942.482884:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367316352 00000100:00100000:0.0:1787833942.482894:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367316352 00000100:00100000:0.0:1787833942.482938:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367316480 00000100:00100000:0.0:1787833942.482941:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367316480 00000100:00100000:0.0:1787833942.482958:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787833942.482967:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1874679367316352:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787833942.483007:0:15130:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from a4b79920-a7bc-4762-befe-a82a11d15d6c@192.168.202.15@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:0.0:1787833942.483045:0:15130:0:(genops.c:1385:class_connect()) connect: client a4b79920-a7bc-4762-befe-a82a11d15d6c, cookie 0x2bdb54ee5e7760fd 00002000:00100000:0.0:1787833942.483058:0:15130:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a4b79920-a7bc-4762-befe-a82a11d15d6c/ffff9b6468ff4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787833942.483087:0:15130:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787833942.483326:0:15130:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787833942.483401:0:15130:0:(import.c:65:import_set_state_nolock()) ffff9b64502d5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787833942.483495:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2343:x1874679367316352:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 527us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.483504:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787833942.483524:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787833942.483529:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477406940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1874679367316480:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787833942.483546:0:15130:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from a4b79920-a7bc-4762-befe-a82a11d15d6c@192.168.202.15@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:0.0:1787833942.483563:0:15130:0:(genops.c:1385:class_connect()) connect: client a4b79920-a7bc-4762-befe-a82a11d15d6c, cookie 0x2bdb54ee5e776104 00002000:00100000:0.0:1787833942.483569:0:15130:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a4b79920-a7bc-4762-befe-a82a11d15d6c/ffff9b64502e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113962 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787833942.483577:0:15130:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1787833942.483714:0:15130:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787833942.483730:0:15130:0:(import.c:65:import_set_state_nolock()) ffff9b6468d9e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787833942.483755:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477406940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2343:x1874679367316480:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 224us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.483761:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787833942.487983:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833942.488106:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367316608 00000100:00100000:3.0:1787833942.488116:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367316608 00000100:00100000:3.0:1787833942.488175:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:3.0:1787833942.488186:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:13874:x1874679367316608:12345-192.168.202.15@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787833942.488599:0:14448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787833942.488752:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:13874:x1874679367316608:12345-192.168.202.15@tcp:33:mount.lustre.0 Request processed in 567us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833942.488772:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:3.0:1787833942.686094:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833942.686211:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367316736 00000100:00100000:0.0:1787833942.686222:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367316736 00000100:00100000:0.0:1787833942.686302:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787833942.686314:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:13905:x1874679367316736:12345-192.168.202.15@tcp:101:mkdir.0 00010000:00010000:0.0:1787833942.686337:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833942.686390:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e77610b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f0b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833942.686625:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833942.686641:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833942.686656:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833942.686876:0:14446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787833942.686881:0:14446:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833942.686969:0:14446:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833942.687002:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e77610b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f0b expref: 8 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833942.687021:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f0b expref: 7 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833942.687030:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833942.687033:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833942.687037:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751ec00, rc 0) 00000100:00100000:0.0:1787833942.687120:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+7:13905:x1874679367316736:12345-192.168.202.15@tcp:101:mkdir.0 Request processed in 808us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833942.687129:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00010000:00010000:3.0:1787833942.780595:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833943.618903:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647f939e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375695488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833943.618982:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833943.619168:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375695488 00000100:00100000:2.0:1787833943.619176:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375695488 00000100:00100000:2.0:1787833943.619254:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833943.619263:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375695488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787833943.619302:0:15132:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833943.619381:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375695488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833943.619389:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787833943.619457:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647f939e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375695488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787833943.619626:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787833943.804711:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787833944.751474:0:5838:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a4b79920-a7bc-4762-befe-a82a11d15d6c 00000001:00100000:0.0:1787833944.751489:0:5838:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4865fa16-b0dc-4920-8df4-908aff1ec664 00010000:00010000:3.0:1787833944.828538:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787833945.215509:0:14477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787833945.662847:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833945.662876:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460344780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375695616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833945.662973:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833945.663081:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6449185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3282:1874679375695744:0@lo:400:kworker.0 00000100:00100000:1.0:1787833945.663110:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1874679375696128:0@lo:400:kworker.0 00000100:00100000:0.0:1787833945.663122:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833945.663169:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833945.663175:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375696256:0@lo:400:kworker.0 00000100:00100000:1.0:1787833945.663204:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833945.663212:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833945.663215:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375696000:0@lo:400:kworker.0 00000100:00100000:0.0:1787833945.663241:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787833945.663250:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833945.663252:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462316580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375695872:0@lo:400:kworker.0 00000100:00100000:0.0:1787833945.663285:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833945.663294:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375696128 00000100:00100000:1.0:1787833945.663303:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375696128 00000100:00100000:0.0:1787833945.663336:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375695744 00000100:00100000:0.0:1787833945.663361:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375695744 00000100:00100000:1.0:1787833945.663393:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375696256 00000100:00100000:1.0:1787833945.663412:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375696256 00000100:00100000:0.0:1787833945.663413:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787833945.663436:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3282:x1874679375695744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833945.663448:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375696000 00000100:00100000:1.0:1787833945.663452:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375696000 00000100:00100000:1.0:1787833945.663470:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787833945.663480:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874679375696128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833945.663493:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3282:x1874679375695744:12345-0@lo:400:kworker.0 Request processed in 70us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833945.663502:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787833945.663530:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1874679375696128:12345-0@lo:400:kworker.0 Request processed in 52us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833945.663539:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787833945.663548:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375696256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833945.663582:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375696256:12345-0@lo:400:kworker.0 Request processed in 35us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833945.663595:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375695616 00000100:00100000:2.0:1787833945.663600:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375695616 00000100:00100000:2.0:1787833945.663633:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833945.663640:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460344b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375695616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833945.663669:0:15132:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833945.663708:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460344b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375695616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833945.663715:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787833945.663756:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460344780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375695616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833945.664080:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787833945.664099:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787833945.664106:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375696000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833945.664140:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1874679375696000:12345-0@lo:400:kworker.0 Request processed in 35us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833945.664227:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787833945.664248:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787833945.664252:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833945.664261:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787833945.664285:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1874679375696000:0@lo:400:kworker.0 00000100:00100000:1.0:1787833945.664296:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462317c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1874679375696128:0@lo:400:kworker.0 00000100:00100000:1.0:1787833945.664370:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375695872 00000100:00100000:1.0:1787833945.664375:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375695872 00000100:00100000:1.0:1787833945.664414:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787833945.664421:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375695872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787833945.664467:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375695872:12345-0@lo:400:kworker.0 Request processed in 47us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833945.664473:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787833945.664495:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787833945.664516:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462316580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375695872:0@lo:400:kworker.0 00000100:00100000:1.0:1787833945.664545:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6449185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3282:1874679375695744:0@lo:400:kworker.0 00000100:00100000:1.0:1787833945.664559:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462316940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375696256:0@lo:400:kworker.0 00010000:00010000:1.0:1787833945.852989:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787833946.266044:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a4b79920-a7bc-4762-befe-a82a11d15d6c 00000001:02000400:0.0:1787833946.331209:0:16413:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1787833946.783544:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4b79920-a7bc-4762-befe-a82a11d15d6c 00010000:00010000:3.0:1787833946.876614:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833947.831724:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833947.831771:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833947.831811:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833947.831842:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833947.831861:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833947.831877:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833947.831899:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833947.831927:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367317248 00000100:00100000:1.0:1787833947.831937:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367317248 00000100:00100000:1.0:1787833947.831993:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367317504 00000100:00100000:1.0:1787833947.831997:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367317504 00000100:00100000:1.0:1787833947.832011:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367317120 00000100:00100000:1.0:1787833947.832013:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367317120 00000100:00100000:1.0:1787833947.832025:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367317632 00000100:00100000:1.0:1787833947.832027:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367317632 00000100:00100000:1.0:1787833947.832044:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787833947.832054:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2347:x1874679367317248:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833947.832136:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2347:x1874679367317248:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 85us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833947.832144:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787833947.832161:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787833947.832168:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2347:x1874679367317504:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833947.832193:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2347:x1874679367317504:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833947.832223:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787833947.832235:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787833947.832241:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2347:x1874679367317120:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833947.832262:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2347:x1874679367317120:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 22us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833947.832268:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787833947.832276:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787833947.832281:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477616d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2347:x1874679367317632:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833947.832297:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477616d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2347:x1874679367317632:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 16us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833947.832303:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787833947.832323:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367316864 00000100:00100000:1.0:1787833947.832326:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367316864 00000100:00100000:0.0:1787833947.832924:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367316992 00000100:00100000:0.0:1787833947.832930:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367316992 00000100:00100000:0.0:1787833947.832967:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367317376 00000100:00100000:0.0:1787833947.832970:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367317376 00000100:00100000:0.0:1787833947.832993:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787833947.833001:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6449185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+6:2347:x1874679367316992:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833947.833049:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6449185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+6:2347:x1874679367316992:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 49us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833947.833056:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787833947.833068:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787833947.833074:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477617840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2347:x1874679367317376:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833947.833094:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477617840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2347:x1874679367317376:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 20us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833947.833099:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00080000:2.0:1787833947.833522:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787833947.833527:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787833947.833536:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787833947.834005:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:1.0:1787833947.834018:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:2347:x1874679367316864:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833947.834056:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:2347:x1874679367316864:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 44us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833947.834063:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 104 00010000:00010000:1.0:1787833947.907146:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833948.733881:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833948.733907:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375696384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787833948.733985:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833948.734080:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375696384 00000100:00100000:3.0:1787833948.734088:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375696384 00000100:00100000:3.0:1787833948.734153:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833948.734164:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375696384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833948.734208:0:15132:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833948.734268:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375696384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833948.734276:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787833948.734357:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375696384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787833948.734574:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787833948.927701:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833949.949837:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787833950.448226:0:16564:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdca4049d0 20000000:00000080:2.0:1787833950.448246:0:16564:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b634112c000 uarg=0000000000000000 20000000:01000000:2.0:1787833950.448285:0:16564:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787833950.448291:0:16564:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787833950.448295:0:16564:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787833950.449621:0:16565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787833950.450053:0:16564:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787833950.452960:0:16564:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787833950.452991:0:16564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453007:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e09 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453013:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775e56 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453017:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e775f8a expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453025:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e7f expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453032:0:16564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ee1 expref: 12 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453058:0:16564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453101:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ee1 expref: 12 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453120:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ee1 expref: 12 pid: 14437 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833950.453134:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375696512:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833950.453244:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e7f expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453252:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e7f expref: 12 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833950.453260:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375696640:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833950.453291:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e775f8a expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.453298:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e775f8a expref: 18 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833950.453306:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462317840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375696768:0@lo:104: 00000100:00100000:0.0:1787833950.453367:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833950.453512:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375696768 00000100:00100000:2.0:1787833950.453520:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375696768 00000100:00100000:2.0:1787833950.453715:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787833950.453726:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:16564:x1874679375696768:12345-0@lo:104: 00010000:00010000:2.0:1787833950.453740:0:14427:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833950.453819:0:14427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787833950.453826:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:16564:x1874679375696768:12345-0@lo:104: Request processed in 103us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833950.453833:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787833950.453876:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833950.453884:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.453903:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d800 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:3.0:1787833950.453907:0:14433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.453916:0:14433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833950.453922:0:14433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787833950.453927:0:14433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787833950.453959:0:14433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.453965:0:14433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833950.453986:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.453993:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d800/0x2bdb54ee5e775f8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775f91 expref: -99 pid: 15847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.454006:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833950.454008:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833950.454009:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833950.454029:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647745e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3280:1874679375696896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787833950.454060:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833950.454104:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375696896 00000100:00100000:3.0:1787833950.454108:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375696896 00010000:00010000:3.0:1787833950.454128:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775f8a expref: 19 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833950.454158:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833950.454165:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3280:x1874679375696896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833950.454176:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833950.454181:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775f8a expref: 19 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.454190:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e775f8a expref: 19 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.454205:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833950.454232:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3280:x1874679375696896:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833950.454239:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787833950.454285:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647745e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3280:1874679375696896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787833950.455605:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e775e56 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.455634:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e56 expref: 18 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833950.455647:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462317480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375697024:0@lo:104: 00000100:00100000:0.0:1787833950.455693:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787833950.455894:0:16564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bdb54ee5e775e09 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833950.455903:0:16564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e09 expref: 18 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833950.455912:0:16564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462316940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375697152:0@lo:104: 00000100:00100000:0.0:1787833950.455939:0:16564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833950.457678:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833950.457787:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833950.457815:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367317760 00000100:00100000:3.0:1787833950.457823:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367317760 00010000:00010000:3.0:1787833950.457860:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ee1 expref: 13 pid: 14437 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833950.457890:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367317888 00000100:00100000:3.0:1787833950.457893:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367317888 00010000:00010000:3.0:1787833950.457905:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e7f expref: 14 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833950.457920:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787833950.457928:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ea64ce-9f56-4ecd-b929-99c45af8c173+14:2344:x1874679367317760:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833950.457957:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833950.457965:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ee1 expref: 14 pid: 14437 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.457976:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ee1 expref: 14 pid: 14437 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.457995:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833950.458040:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ea64ce-9f56-4ecd-b929-99c45af8c173+14:2344:x1874679367317760:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 112us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833950.458047:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787833950.458067:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787833950.458074:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6442c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:2344:x1874679367317888:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833950.458082:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833950.458086:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e7f expref: 13 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.458094:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e7f expref: 13 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.458103:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833950.458120:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6442c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:2344:x1874679367317888:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 46us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833950.458126:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:0.0:1787833950.458893:0:16564:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452d7e6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787833950.458929:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6476c82e00/0x2bdb54ee5e7760ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ee1 expref: 12 pid: 14437 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833950.458947:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375696512:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833950.458959:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b647fcd6800/0x2bdb54ee5e7760b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3e7f expref: 11 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833950.458967:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462314000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375696640:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833950.458978:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6479dd2200/0x2bdb54ee5e775f91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e775f8a expref: 18 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833950.458986:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462317840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375696768:0@lo:104: 00000100:00100000:3.0:1787833950.462642:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375697024 00000100:00100000:3.0:1787833950.462657:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375697024 00000100:00100000:3.0:1787833950.462742:0:15155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375697152 00000100:00100000:3.0:1787833950.462746:0:15155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375697152 00000100:00100000:3.0:1787833950.463146:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833950.463158:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462315a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+4:16564:x1874679375697024:12345-0@lo:104: 00010000:00010000:3.0:1787833950.463177:0:15155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.463284:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787833950.463291:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462315a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+4:16564:x1874679375697024:12345-0@lo:104: Request processed in 137us (7598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833950.463298:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787833950.463318:0:15155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787833950.463325:0:15155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:16564:x1874679375697152:12345-0@lo:104: 00010000:00010000:3.0:1787833950.463334:0:15155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833950.463377:0:14432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833950.463394:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833950.463402:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6442a2d600 already unused, calling callback (ffffffffc1e04c20) 00010000:00010000:3.0:1787833950.463403:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787833950.463408:0:15155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477801850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+3:16564:x1874679375697152:12345-0@lo:104: Request processed in 84us (7469us total) trans 0 rc 0/0 10000000:00010000:1.0:1787833950.463413:0:14432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833950.463414:0:15155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787833950.463422:0:14432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787833950.463430:0:14432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833950.463435:0:14432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787833950.463464:0:14433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787833950.463473:0:14432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833950.463479:0:14432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787833950.463499:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833950.463506:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6442a2d600/0x2bdb54ee5e775e56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775e5d expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833950.463519:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833950.463520:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787833950.463522:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833950.463535:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3281:1874679375697280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787833950.463573:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833950.463624:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375697280 00000100:00100000:1.0:1787833950.463629:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375697280 00010000:00010000:1.0:1787833950.463648:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e56 expref: 18 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.463664:0:16566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833950.463669:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833950.463669:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787833950.463682:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:3281:x1874679375697280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787833950.463694:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833950.463700:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e56 expref: 18 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833950.463711:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e56 expref: 18 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833950.463727:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787833950.463738:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6462198c00 already unused, calling callback (ffffffffc1e04c20) 10000000:00010000:3.0:1787833950.463741:0:14433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.463749:0:14433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787833950.463762:0:14433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833950.463765:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:3281:x1874679375697280:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (193us total) trans 0 rc 0/0 10000000:01000000:3.0:1787833950.463768:0:14433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787833950.463772:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787833950.463806:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3281:1874679375697280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833950.463961:0:14433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.463967:0:14433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787833950.463991:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.463998:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff9b6462198c00/0x2bdb54ee5e775e09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bdb54ee5e775e10 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.464011:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833950.464012:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833950.464014:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833950.464019:0:16566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833950.464021:0:16566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833950.464130:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787833950.464141:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647745e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375697408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787833950.464184:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787833950.464244:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6479dd3800/0x2bdb54ee5e775e5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e775e56 expref: 17 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833950.464254:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462317480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375697024:0@lo:104: 00000100:00100000:2.0:1787833950.464262:0:16564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462316940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16564:1874679375697152:0@lo:104: 00010000:00010000:2.0:1787833950.464296:0:16564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833950.464972:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375697408 00000100:00100000:3.0:1787833950.464979:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375697408 00010000:00010000:3.0:1787833950.465003:0:14430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e09 expref: 17 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833950.465034:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787833950.465041:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460345680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:3283:x1874679375697408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787833950.465050:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833950.465055:0:14430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e09 expref: 17 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465075:0:14430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bdb54ee5e775e09 expref: 17 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465088:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b647751ee00/0x2bdb54ee5e775e10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bdb54ee5e775e09 expref: 17 pid: 14439 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465100:0:14430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465108:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465122:0:14430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465129:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465136:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465142:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465149:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f000 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833950.465152:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465161:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465188:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833950.465198:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833950.465244:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460345680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:3283:x1874679375697408:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833950.465251:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787833950.465285:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647745e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375697408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787833950.465524:0:14428:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:2.0:1787833950.467590:0:16564:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833950.467608:0:16564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833950.467615:0:16564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b647751f000/0x2bdb54ee5e776119 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833950.781372:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375697536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833950.781467:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833950.781562:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375697536 00000100:00100000:2.0:1787833950.781571:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375697536 00000100:00100000:2.0:1787833950.781642:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787833950.781651:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460347840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375697536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787833950.781691:0:15132:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787833950.781738:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460347840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874679375697536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833950.781746:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787833950.785414:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787833950.785501:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1874679375697536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787833950.787220:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375697664:0@lo:400:kworker.0 00000100:00100000:2.0:1787833950.787552:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833950.787610:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833950.787618:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64603452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375697792:0@lo:400:kworker.0 00000100:00100000:2.0:1787833950.787647:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833950.787691:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460344f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375697920:0@lo:400:kworker.0 00000100:00100000:2.0:1787833950.787718:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833950.787737:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787833950.787742:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6460347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375698048:0@lo:400:kworker.0 00000100:00100000:2.0:1787833950.787765:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833950.788975:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375697664 00000100:00100000:2.0:1787833950.788986:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375697664 00000100:00100000:2.0:1787833950.789056:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833950.789066:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375697664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833950.789130:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375697664:12345-0@lo:400:kworker.0 Request processed in 66us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833950.789137:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787833950.789158:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833950.789202:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375697664:0@lo:400:kworker.0 00000100:00100000:0.0:1787833950.800956:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375697792 00000100:00100000:0.0:1787833950.800970:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375697792 00000100:00100000:0.0:1787833950.801027:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375697920 00000100:00100000:0.0:1787833950.801031:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375697920 00000100:00100000:0.0:1787833950.801057:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375698048 00000100:00100000:0.0:1787833950.801060:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375698048 00000100:00100000:0.0:1787833950.801078:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787833950.801088:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375697792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833950.801418:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375697792:12345-0@lo:400:kworker.0 Request processed in 176us (13615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833950.801428:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787833950.801448:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787833950.801456:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375697920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833950.801499:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375697920:12345-0@lo:400:kworker.0 Request processed in 45us (13780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833950.801505:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787833950.801516:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787833950.801522:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460346940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375698048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833950.801550:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460346940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874679375698048:12345-0@lo:400:kworker.0 Request processed in 29us (13785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833950.801555:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787833950.801579:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787833950.801617:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64603452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375697792:0@lo:400:kworker.0 00000100:00100000:0.0:1787833950.801654:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1874679375698048:0@lo:400:kworker.0 00000100:00100000:0.0:1787833950.801665:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6460344f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375697920:0@lo:400:kworker.0 00010000:00010000:1.0:1787833950.972580:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787833951.619285:0:14441:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787833951.619293:0:14441:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b646dc8e000 from 10 10000000:01000000:3.0:1787833951.619299:0:14441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787833951.621535:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3400/0x2bdb54ee5e776120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833951.621559:0:14441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3400/0x2bdb54ee5e776120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833951.621574:0:14441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3400/0x2bdb54ee5e776120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833951.621612:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647745e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787833951.621903:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833951.621992:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442f5b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833951.622067:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375698176 00000100:00100000:2.0:1787833951.622076:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375698176 00000100:00100000:2.0:1787833951.622133:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787833951.622142:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+16:14441:x1874679375698176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787833951.622158:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833951.622176:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e776127 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e776120 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833951.622200:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e776127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e776120 expref: 17 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833951.622210:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6476c82200/0x2bdb54ee5e776127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e776120 expref: 17 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833951.622234:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c82200, rc 0) 00000100:00100000:2.0:1787833951.622284:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:14441:x1874679375698176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833951.622292:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787833951.622649:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647745e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787833951.622673:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3400/0x2bdb54ee5e776120 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e776127 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833951.622682:0:14441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3400/0x2bdb54ee5e776120 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e776127 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833951.622922:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647745e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833951.623645:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833951.623733:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6442f5b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833951.634219:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375698304 00000100:00100000:2.0:1787833951.634235:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375698304 00000100:00100000:3.0:1787833951.642401:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787833951.642421:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:14441:x1874679375698304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787833951.642799:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:14441:x1874679375698304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (19157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833951.642808:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787833951.644250:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647745e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833951.644332:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833951.644446:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833951.644491:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450914840 going to sleep for 11 seconds 00000100:00100000:1.0:1787833951.644684:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375698432 00000100:00100000:1.0:1787833951.644703:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375698432 00000100:00100000:1.0:1787833951.644753:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787833951.644763:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:14441:x1874679375698432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833951.644968:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:14441:x1874679375698432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833951.644976:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787833951.645024:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787833951.645687:0:16601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787833951.645742:0:14441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787833951.645764:0:14441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833951.645776:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3400/0x2bdb54ee5e776120 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e776127 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.645800:0:14441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b6479dd3400/0x2bdb54ee5e776120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e776127 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833951.645813:0:14441:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787833951.645816:0:14441:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b647760c800 from 10 10000000:01000000:1.0:1787833951.645820:0:14441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833951.645854:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6c00/0x2bdb54ee5e77612e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.645861:0:14441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6c00/0x2bdb54ee5e77612e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.645872:0:14441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6c00/0x2bdb54ee5e77612e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833951.645890:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833951.645936:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833951.645959:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833951.645979:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375698560 00000100:00100000:1.0:1787833951.645984:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375698560 00000100:00100000:1.0:1787833951.646010:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787833951.646018:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+17:14441:x1874679375698560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833951.646028:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833951.646040:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647fcd7400/0x2bdb54ee5e776135 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e77612e expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.646061:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647fcd7400/0x2bdb54ee5e776135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e77612e expref: 18 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.646083:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647fcd7400/0x2bdb54ee5e776135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e77612e expref: 18 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.646091:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd7400, rc 0) 00000100:00100000:1.0:1787833951.646125:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:14441:x1874679375698560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833951.646132:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787833951.646168:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833951.646181:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6c00/0x2bdb54ee5e77612e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e776135 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.646189:0:14441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6c00/0x2bdb54ee5e77612e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e776135 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833951.646231:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833951.646255:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833951.646286:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833951.646298:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375698688 00000100:00100000:1.0:1787833951.646301:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375698688 00000100:00100000:1.0:1787833951.646317:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787833951.646323:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:14441:x1874679375698688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833951.646599:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:14441:x1874679375698688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833951.646606:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787833951.646635:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833951.646672:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833951.646708:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833951.646721:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea540 going to sleep for 11 seconds 00000100:00100000:1.0:1787833951.646734:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375698816 00000100:00100000:1.0:1787833951.646739:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375698816 00000100:00100000:1.0:1787833951.646755:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787833951.646761:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:14441:x1874679375698816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833951.646889:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:14441:x1874679375698816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833951.646896:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787833951.646930:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787833951.647654:0:16602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787833951.647697:0:14441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787833951.647714:0:14441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787833951.647722:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6c00/0x2bdb54ee5e77612e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e776135 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.647731:0:14441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6c00/0x2bdb54ee5e77612e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e776135 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787833951.647740:0:14441:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787833951.647743:0:14441:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b6477609800 from 10 10000000:01000000:1.0:1787833951.647745:0:14441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787833951.647767:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6a00/0x2bdb54ee5e77613c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.647774:0:14441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6a00/0x2bdb54ee5e77613c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.647790:0:14441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6a00/0x2bdb54ee5e77613c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833951.647806:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787833951.647845:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833951.647861:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833951.647881:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375698944 00000100:00100000:1.0:1787833951.647884:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375698944 00000100:00100000:1.0:1787833951.647907:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787833951.647913:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+18:14441:x1874679375698944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833951.647922:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833951.647933:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e776143 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bdb54ee5e77613c expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.647948:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e776143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bdb54ee5e77613c expref: 19 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.647957:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647fcd7200/0x2bdb54ee5e776143 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bdb54ee5e77613c expref: 19 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.647964:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd7200, rc 0) 00000100:00100000:1.0:1787833951.647991:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:14441:x1874679375698944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833951.647997:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787833951.648028:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375698944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833951.648039:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6a00/0x2bdb54ee5e77613c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e776143 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833951.648053:0:14441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6a00/0x2bdb54ee5e77613c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bdb54ee5e776143 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833951.648096:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375699072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833951.648119:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833951.648131:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64772ea780 going to sleep for 11 seconds 00000100:00100000:1.0:1787833951.648141:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375699072 00000100:00100000:1.0:1787833951.648144:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375699072 00000100:00100000:1.0:1787833951.648160:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787833951.648165:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6443fa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:14441:x1874679375699072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833951.649552:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b64776152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375699072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787833951.649602:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375699200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833951.649664:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833951.649684:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6450914600 going to sleep for 11 seconds 00000100:00100000:0.0:1787833951.649716:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375699200 00000100:00100000:0.0:1787833951.649721:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375699200 00000100:00100000:0.0:1787833951.649752:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787833951.649760:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+20:14441:x1874679375699200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787833951.649931:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+20:14441:x1874679375699200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833951.650173:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787833951.650221:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462314f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:14441:1874679375699200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787833951.652257:0:16603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787833951.652386:0:14441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787833951.652416:0:14441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787833951.652428:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6a00/0x2bdb54ee5e77613c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e776143 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833951.652439:0:14441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff9b647fcd6a00/0x2bdb54ee5e77613c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bdb54ee5e776143 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833951.663424:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6443fa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:14441:x1874679375699072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833951.663449:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00010000:3.0:1787833951.997484:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833952.390040:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833952.390150:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367318016 00000100:00100000:0.0:1787833952.390174:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367318016 00000100:00100000:0.0:1787833952.390225:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:0.0:1787833952.390235:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b645924a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+11:13761:x1874679367318016:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787833952.390253:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833952.390272:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647751f800/0x2bdb54ee5e77614a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f12 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.390300:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647751f800/0x2bdb54ee5e77614a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f12 expref: 12 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.390312:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647751f800/0x2bdb54ee5e77614a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f12 expref: 12 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833952.390335:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f800, rc 0) 00000100:00100000:0.0:1787833952.390427:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b645924a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13761:x1874679367318016:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 193us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833952.390434:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:2.0:1787833952.394022:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833952.395500:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367318144 00000100:00100000:1.0:1787833952.395514:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367318144 00000100:00100000:1.0:1787833952.395594:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:1.0:1787833952.395604:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6459249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13761:x1874679367318144:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833952.395909:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6459249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13761:x1874679367318144:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 304us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833952.395917:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:3.0:1787833952.400049:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833952.400398:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367318272 00000100:00100000:1.0:1787833952.400410:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367318272 00000100:00100000:1.0:1787833952.400469:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:1.0:1787833952.400481:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13761:x1874679367318272:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787833952.400735:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13761:x1874679367318272:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 255us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833952.400752:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:1.0:1787833952.409157:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833952.413852:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367318400 00000100:00100000:0.0:1787833952.413866:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367318400 00000100:00100000:1.0:1787833952.414004:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:1.0:1787833952.414016:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+12:13761:x1874679367318400:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787833952.414034:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833952.414054:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b647fcd6e00/0x2bdb54ee5e776151 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f19 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833952.414082:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b647fcd6e00/0x2bdb54ee5e776151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f19 expref: 13 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833952.414093:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b647fcd6e00/0x2bdb54ee5e776151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f19 expref: 13 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833952.414102:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6e00, rc 0) 00000100:00100000:1.0:1787833952.414169:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13761:x1874679367318400:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 155us (5024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833952.414176:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:0.0:1787833952.417497:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833952.417596:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367318528 00000100:00100000:1.0:1787833952.417606:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367318528 00000100:00100000:1.0:1787833952.417659:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:1.0:1787833952.417669:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13761:x1874679367318528:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787833952.417960:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13761:x1874679367318528:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 292us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833952.417969:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:1.0:1787833952.433882:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833952.434241:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367318656 00000100:00100000:3.0:1787833952.434252:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367318656 00000100:00100000:2.0:1787833952.437158:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:2.0:1787833952.437175:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13761:x1874679367318656:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787833952.437715:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:13761:x1874679367318656:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 542us (3840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833952.437724:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:0.0:1787833952.943081:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833952.943119:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833952.943153:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833952.943176:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833952.943194:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833952.943217:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833952.943245:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367319040 00000100:00100000:0.0:1787833952.943257:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367319040 00000100:00100000:0.0:1787833952.943367:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367319296 00000100:00100000:0.0:1787833952.943390:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367319296 00000100:00100000:0.0:1787833952.943411:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367318912 00000100:00100000:0.0:1787833952.943414:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367318912 00000100:00100000:0.0:1787833952.943426:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367319424 00000100:00100000:0.0:1787833952.943428:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367319424 00000100:00100000:0.0:1787833952.943444:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:0.0:1787833952.943454:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2347:x1874679367319040:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833952.943531:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462316580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2347:x1874679367319040:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 78us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833952.943538:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787833952.943826:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787833952.943836:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462317c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2347:x1874679367319296:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833952.943884:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462317c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2347:x1874679367319296:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 49us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.943891:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787833952.943909:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787833952.943915:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462316940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2347:x1874679367318912:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833952.943939:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462316940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2347:x1874679367318912:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 25us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.943945:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787833952.943967:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:3.0:1787833952.943974:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462317840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2347:x1874679367319424:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787833952.944001:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462317840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2347:x1874679367319424:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833952.944007:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787833952.944470:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367318784 00000100:00100000:0.0:1787833952.944476:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367318784 00000100:00100000:0.0:1787833952.944555:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367319168 00000100:00100000:0.0:1787833952.944559:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367319168 00000100:00100000:1.0:1787833952.954745:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:1.0:1787833952.954777:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+6:2347:x1874679367318784:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833952.954889:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+6:2347:x1874679367318784:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 123us (11812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833952.954898:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:1.0:1787833952.954926:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:1.0:1787833952.954933:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2347:x1874679367319168:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787833952.954961:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2347:x1874679367319168:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (11765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833952.954967:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00080000:0.0:1787833952.955331:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833952.955364:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833952.955368:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787833953.020565:0:16566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787833953.853811:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375699328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833953.853894:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833953.853962:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375699328 00000100:00100000:3.0:1787833953.853970:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375699328 00000100:00100000:3.0:1787833953.854030:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787833953.854041:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460345e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375699328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833953.854076:0:15132:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833953.854136:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460345e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375699328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833953.854144:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787833953.854414:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375699328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787833953.854569:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787833954.044672:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787833954.203147:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.203219:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367319552 00000100:00100000:0.0:1787833954.203230:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367319552 00000100:00100000:0.0:1787833954.203322:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787833954.203335:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477615a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+6:14416:x1874679367319552:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833954.203397:0:16323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833954.203419:0:16323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776158 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f20 expref: -99 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.203504:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.203519:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.203547:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.203566:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.203573:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.203579:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.204578:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77616d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.204597:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77616d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.204606:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77616d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787833954.204795:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787833954.205031:0:16323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787833954.205036:0:16323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833954.205137:0:16323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77616d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205151:0:16323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205158:0:16323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205175:0:16323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205181:0:16323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751fe00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833954.205186:0:16323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205193:0:16323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205205:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833954.205208:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833954.205212:0:16323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205218:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e77615f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205230:0:16323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205237:0:16323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205242:0:16323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205246:0:16323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ee00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833954.205249:0:16323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205264:0:16323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205273:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b646021d400) 00010000:00010000:0.0:1787833954.205275:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833954.205279:0:16323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205284:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e776166 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205335:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776158 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f20 expref: 8 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205411:0:16323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f000/0x2bdb54ee5e77616d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f20 expref: 7 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.205418:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b646021de00) 00010000:00010000:0.0:1787833954.205420:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833954.205422:0:16323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f000, rc 0) 00000100:00100000:0.0:1787833954.205939:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477615a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+7:14416:x1874679367319552:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2604us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.205949:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787833954.226981:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833954.227126:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367319808 00000100:00100000:2.0:1787833954.227138:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367319808 00000100:00100000:2.0:1787833954.227205:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787833954.227215:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+7:14416:x1874679367319808:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787833954.227238:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833954.227260:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e776174 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f27 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.227418:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.227433:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.227445:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.227496:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.227503:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.227510:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228032:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e776189 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228042:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e776189 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228050:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e776189 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833954.228062:0:14444:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787833954.228333:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228389:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228397:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228403:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833954.228408:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228416:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228430:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b646021de00) 00010000:00010000:2.0:1787833954.228433:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833954.228438:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228445:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77617b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228462:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228468:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228474:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228479:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833954.228489:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228497:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228505:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b6474279e00) 00010000:00010000:2.0:1787833954.228509:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833954.228512:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228518:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776182 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228890:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83000/0x2bdb54ee5e776174 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f27 expref: 10 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228906:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83800/0x2bdb54ee5e776189 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f27 expref: 9 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.228914:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:2.0:1787833954.228916:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833954.228919:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83800, rc 0) 00000100:00100000:2.0:1787833954.229001:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+9:14416:x1874679367319808:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1787us (2030us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787833954.229009:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787833954.244105:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.244203:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367319936 00000100:00100000:0.0:1787833954.244214:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367319936 00000100:00100000:0.0:1787833954.244275:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787833954.244286:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477616940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+9:14416:x1874679367319936:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787833954.244468:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477616940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+9:14416:x1874679367319936:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 Request processed in 183us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.244476:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:1.0:1787833954.287797:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833954.287945:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367320064 00000100:00100000:2.0:1787833954.287956:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367320064 00000100:00100000:2.0:1787833954.288024:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:2.0:1787833954.288035:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477616580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+9:14422:x1874679367320064:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833954.288070:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833954.288092:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776197 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f2e expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288164:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288179:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288191:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288206:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288213:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288220:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288565:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288575:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288581:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288588:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833954.288599:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288606:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288619:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:2.0:1787833954.288622:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833954.288627:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288633:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77619e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288649:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288655:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288660:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288666:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833954.288668:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288674:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288682:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6474279e00) 00010000:00010000:2.0:1787833954.288684:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833954.288694:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288700:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83200/0x2bdb54ee5e7761a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288737:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776197 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f2e expref: 10 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288937:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:2.0:1787833954.288940:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833954.288945:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83c00/0x2bdb54ee5e776197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f2e expref: 10 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.288956:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83c00, rc 0) 00000100:00100000:2.0:1787833954.289015:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477616580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+9:14422:x1874679367320064:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 982us (1233us total) trans 0 rc 301/301 00000100:00100000:2.0:1787833954.289023:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:2.0:1787833954.302609:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833954.302732:0:14453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367320192 00000100:00100000:1.0:1787833954.302741:0:14453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367320192 00000100:00100000:1.0:1787833954.302800:0:14453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787833954.302810:0:14453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460347c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4865fa16-b0dc-4920-8df4-908aff1ec664+9:14422:x1874679367320192:12345-192.168.202.15@tcp:700:lfs.0 00000100:00100000:1.0:1787833954.302896:0:14453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460347c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4865fa16-b0dc-4920-8df4-908aff1ec664+9:14422:x1874679367320192:12345-192.168.202.15@tcp:700:lfs.0 Request processed in 87us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833954.302904:0:14453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787833954.304822:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.310684:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367320448 00000100:00100000:0.0:1787833954.310700:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367320448 00000100:00100000:0.0:1787833954.310768:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787833954.310778:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477615680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+9:14422:x1874679367320448:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:0.0:1787833954.310841:0:14446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833954.310871:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82000/0x2bdb54ee5e7760da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3ea9 expref: 9 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.310895:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833954.310900:0:14446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833954.311176:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.311190:0:14446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f0b expref: 5 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.311199:0:14446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.311233:0:14446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f0b expref: 5 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.311247:0:14446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f0b expref: 5 pid: 14446 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833954.311288:0:14446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14446:1874679375699456:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833954.311483:0:14446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6460194b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787833954.313808:0:14446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14446:1874679375699456:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833954.313839:0:14446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833954.314239:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833954.314696:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367320576 00000100:00100000:3.0:1787833954.314704:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367320576 00000100:00080000:2.0:1787833954.314854:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787833954.314941:0:14431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f0b expref: 6 pid: 14446 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833954.314983:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787833954.314992:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2345:x1874679367320576:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787833954.315006:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833954.315012:0:14431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f0b expref: 6 pid: 14446 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.315024:0:14431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f0b expref: 6 pid: 14446 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.315054:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776112 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f0b expref: 6 pid: 14446 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.315072:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:3.0:1787833954.315076:0:14431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.315084:0:14431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.315091:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.315120:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833954.315177:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2345:x1874679367320576:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 186us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833954.315184:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00010000:00010000:0.0:1787833954.315240:0:14446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.315248:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.315282:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.315293:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.315301:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833954.321129:0:14446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787833954.321150:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.321161:0:14446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.321169:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.321183:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833954.321189:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.321198:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.321217:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6474279b00) 00010000:00010000:0.0:1787833954.321220:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833954.321226:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.321232:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833954.321252:0:14446:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064c70192 reply state 00000000ee1361d3 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833954.321263:0:14446:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833954.321416:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477615680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+10:14422:x1874679367320448:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 10635us (16599us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787833954.321426:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00010000:00010000:3.0:1787833954.323209:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.323225:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.323233:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.323238:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ee00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:3.0:1787833954.323242:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.323266:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.323282:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b646021d400) 00010000:00010000:3.0:1787833954.323285:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787833954.323290:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833954.323296:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e7761b3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833954.429059:0:14477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787833954.478866:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.478948:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367320704 00000100:00100000:0.0:1787833954.478956:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367320704 00000100:00100000:0.0:1787833954.479005:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787833954.479013:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477617c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+9:14430:x1874679367320704:12345-192.168.202.15@tcp:101:lctl.0 00010000:00010000:0.0:1787833954.479033:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833954.479050:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f35 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.479127:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e7761c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.479138:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e7761c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.479146:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e7761c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833954.479199:0:14445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787833954.479202:0:14445:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833954.479243:0:14445:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e7761c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.479268:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f35 expref: 11 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.479286:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fe00/0x2bdb54ee5e7761c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f35 expref: 10 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.479294:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:0.0:1787833954.479297:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833954.479301:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751fe00, rc 0) 00000100:00100000:0.0:1787833954.479436:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477617c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+10:14430:x1874679367320704:12345-192.168.202.15@tcp:101:lctl.0 Request processed in 422us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.479443:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:1.0:1787833954.517038:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.517150:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367320832 00000100:00100000:0.0:1787833954.517160:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367320832 00000100:00100000:0.0:1787833954.517239:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787833954.517250:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:14431:x1874679367320832:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833954.517275:0:16323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833954.517296:0:16323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f3c expref: -99 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.517423:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7761cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.517438:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7761cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.517450:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7761cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833954.517513:0:16323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787833954.517518:0:16323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833954.517539:0:16323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7761cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.517564:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f3c expref: 7 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.517582:0:16323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e600/0x2bdb54ee5e7761cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f3c expref: 6 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.517591:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:0.0:1787833954.517594:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833954.517597:0:16323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751e600, rc 0) 00000100:00100000:0.0:1787833954.517667:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:14431:x1874679367320832:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 419us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.517682:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:3.0:1787833954.527515:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.527603:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367320960 00000100:00100000:0.0:1787833954.527611:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367320960 00000100:00100000:0.0:1787833954.527661:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:0.0:1787833954.527670:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:14431:x1874679367320960:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833954.527692:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833954.527712:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f43 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.527777:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.527788:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.527797:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.527806:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.527810:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.527814:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.527908:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e7761eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.527928:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e7761eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.527933:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e7761eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833954.527971:0:14445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787833954.527973:0:14445:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833954.527990:0:14445:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e7761eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528000:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528005:0:14445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528010:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528014:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833954.528017:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528022:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528030:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:0.0:1787833954.528032:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833954.528034:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528045:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e7761dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528055:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528058:0:14445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528062:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528064:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833954.528066:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528069:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528073:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b646021d500) 00010000:00010000:0.0:1787833954.528075:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833954.528076:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528079:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e7761e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528102:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f43 expref: 8 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528118:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e7761eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f43 expref: 7 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.528123:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b646021df00) 00010000:00010000:0.0:1787833954.528124:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833954.528126:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751fc00, rc 0) 00000100:00100000:0.0:1787833954.528182:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+7:14431:x1874679367320960:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 514us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.528187:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787833954.549677:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.549793:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367321216 00000100:00100000:0.0:1787833954.549805:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367321216 00000100:00100000:0.0:1787833954.549873:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:0.0:1787833954.549885:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+7:14431:x1874679367321216:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833954.549909:0:16323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833954.549932:0:16323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f4a expref: -99 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833954.550060:0:16323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787833954.550193:0:16323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f4a expref: 9 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.550208:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:0.0:1787833954.550211:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787833954.550216:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e7761f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f4a expref: 9 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.550248:0:16323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f600, rc 0) 00000100:00100000:0.0:1787833954.550522:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4b79920-a7bc-4762-befe-a82a11d15d6c+8:14431:x1874679367321216:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 639us (853us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787833954.550530:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:1.0:1787833954.565892:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.565993:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367321472 00000100:00100000:0.0:1787833954.566007:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367321472 00000100:00100000:0.0:1787833954.566076:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:0.0:1787833954.566089:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+8:14431:x1874679367321472:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:0.0:1787833954.566156:0:14445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833954.566184:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e7761eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f43 expref: 8 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.566206:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b646021df00) 00010000:00010000:0.0:1787833954.566217:0:14445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833954.566240:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.566252:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.566263:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833954.566575:0:14445:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b263fb73 reply state 0000000063878f39 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833954.566588:0:14445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787833954.566620:0:14445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787833954.566704:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+9:14431:x1874679367321472:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 618us (823us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787833954.566712:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:3.0:1787833954.570966:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:2.0:1787833954.570971:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.570992:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.571001:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.571009:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833954.571014:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.571039:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.571059:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b646021d500) 00010000:00010000:2.0:1787833954.571062:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787833954.571068:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.571075:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776200 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833954.571247:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367321728 00000100:00100000:0.0:1787833954.571270:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367321728 00000100:00100000:0.0:1787833954.571381:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:0.0:1787833954.571394:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+8:14431:x1874679367321728:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787833954.571716:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+9:14431:x1874679367321728:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 323us (764us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787833954.571724:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787833954.582426:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833954.582540:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367321984 00000100:00100000:1.0:1787833954.582556:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367321984 00000100:00100000:1.0:1787833954.582620:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:1.0:1787833954.582629:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+9:14431:x1874679367321984:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833954.582658:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833954.582681:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f51 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.582893:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.582908:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.582921:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.582938:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.582945:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.582951:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833954.583075:0:14446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787833954.583164:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583183:0:14446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583190:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583196:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833954.583200:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583208:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583220:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:1.0:1787833954.583223:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833954.583227:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583233:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77620e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583247:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583253:0:14446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583259:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583264:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6000 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833954.583271:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583277:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583284:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6442c99b00) 00010000:00010000:1.0:1787833954.583286:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833954.583288:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583294:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776215 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583331:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776207 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f51 expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583837:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:1.0:1787833954.583840:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833954.583845:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f51 expref: 11 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.583858:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6200, rc 0) 00000100:00100000:1.0:1787833954.583937:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+10:14431:x1874679367321984:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1308us (1527us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787833954.583946:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:1.0:1787833954.589597:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.589687:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367322112 00000100:00100000:0.0:1787833954.589697:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367322112 00000100:00100000:0.0:1787833954.589764:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:0.0:1787833954.589775:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+10:14431:x1874679367322112:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787833954.589798:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833954.589822:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e776223 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f58 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.589924:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.589937:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.589949:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833954.590002:0:14445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787833954.590018:0:14445:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833954.590045:0:14445:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.590074:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e776223 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f58 expref: 12 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.590092:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f58 expref: 11 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.590101:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b646021df00) 00010000:00010000:0.0:1787833954.590103:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787833954.590107:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f400, rc 0) 00000100:00100000:0.0:1787833954.590176:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+11:14431:x1874679367322112:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 403us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.590183:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:3.0:1787833954.602438:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.602510:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367322240 00000100:00100000:0.0:1787833954.602526:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367322240 00000100:00100000:0.0:1787833954.602602:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:0.0:1787833954.602611:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+11:14431:x1874679367322240:12345-192.168.202.15@tcp:37:lfs.0 00000100:00100000:0.0:1787833954.616648:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4b79920-a7bc-4762-befe-a82a11d15d6c+11:14431:x1874679367322240:12345-192.168.202.15@tcp:37:lfs.0 Request processed in 14020us (14209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.616666:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787833954.621494:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833954.621641:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367322496 00000100:00100000:2.0:1787833954.621656:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367322496 00000100:00100000:2.0:1787833954.621724:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:2.0:1787833954.621734:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452361850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+11:14431:x1874679367322496:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833954.622048:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452361850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+12:14431:x1874679367322496:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 314us (571us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787833954.622056:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787833954.685593:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.685724:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367322624 00000100:00100000:0.0:1787833954.685750:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367322624 00000100:00100000:0.0:1787833954.685830:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787833954.685841:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+10:14437:x1874679367322624:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787833954.685866:0:16323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833954.685905:0:16323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e776231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f5f expref: -99 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.685984:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686000:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686013:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686028:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686035:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686041:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686158:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776246 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686166:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776246 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686173:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776246 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833954.686207:0:16323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787833954.686212:0:16323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833954.686677:0:16323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776246 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686703:0:16323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686710:0:16323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686717:0:16323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686723:0:16323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751f200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833954.686727:0:16323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686735:0:16323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686943:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:0.0:1787833954.686947:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833954.686952:0:16323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686958:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f200/0x2bdb54ee5e776238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686974:0:16323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686980:0:16323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686986:0:16323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.686997:0:16323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751e800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833954.687001:0:16323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.687007:0:16323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.687015:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b646021d600) 00010000:00010000:0.0:1787833954.687018:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833954.687020:0:16323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.687026:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751e800/0x2bdb54ee5e77623f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.687066:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751fc00/0x2bdb54ee5e776231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f5f expref: 12 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.687080:0:16323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f600/0x2bdb54ee5e776246 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f5f expref: 11 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.687087:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b646021df00) 00010000:00010000:0.0:1787833954.687089:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787833954.687091:0:16323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647751f600, rc 0) 00000100:00100000:0.0:1787833954.687181:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+11:14437:x1874679367322624:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1341us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833954.687190:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:3.0:1787833954.691906:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.692033:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367322880 00000100:00100000:0.0:1787833954.692067:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367322880 00000100:00100000:0.0:1787833954.692149:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:0.0:1787833954.692165:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+11:14437:x1874679367322880:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787833954.692200:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833954.692233:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e77624d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f66 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.692468:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.692486:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f58 expref: 11 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.692497:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.692546:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f58 expref: 11 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.692563:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f58 expref: 11 pid: 14445 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833954.692579:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14445:1874679375699584:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787833954.692698:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64621606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833954.696182:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.696333:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6462315e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14445:1874679375699584:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787833954.696432:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833954.700016:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367323008 00000100:00100000:1.0:1787833954.700032:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367323008 00010000:00010000:1.0:1787833954.700092:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f58 expref: 12 pid: 14445 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833954.700157:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787833954.700172:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+12:2344:x1874679367323008:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833954.700195:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833954.700205:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f58 expref: 12 pid: 14445 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.700222:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f58 expref: 12 pid: 14445 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.700262:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751f400/0x2bdb54ee5e77622a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f58 expref: 12 pid: 14445 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.700281:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b646021df00) 00010000:00010000:1.0:1787833954.700287:0:14429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.700297:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.700305:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.700374:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833954.700452:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+11:2344:x1874679367323008:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 283us (4284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833954.700461:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00010000:00010000:0.0:1787833954.700464:0:14445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.700482:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.700527:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.700542:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.700553:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.703577:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.703607:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.703621:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833954.703636:0:14445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787833954.703672:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.703681:0:14445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.703690:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.703717:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647751ec00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833954.703722:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.703731:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.703825:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b646021df00) 00010000:00010000:0.0:1787833954.703829:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833954.703837:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.703844:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ec00/0x2bdb54ee5e776254 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833954.703863:0:14445:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006724fe45 reply state 00000000afb941ac transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833954.703938:0:14445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787833954.703994:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647751ee00/0x2bdb54ee5e77624d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f66 expref: 14 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.704013:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f66 expref: 13 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833954.704021:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:0.0:1787833954.704023:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787833954.704026:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b64821c4c00, rc 0) 00000100:00100000:0.0:1787833954.704138:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+14:14437:x1874679367322880:12345-192.168.202.15@tcp:101:bash.0 Request processed in 11977us (12260us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787833954.704157:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00010000:00010000:1.0:1787833954.707367:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.707407:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.707416:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.707423:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c4200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833954.707429:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.707437:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.707456:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b646021d300) 00010000:00010000:1.0:1787833954.707460:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787833954.707467:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.707473:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4200/0x2bdb54ee5e77625b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833954.718434:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833954.718607:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367323136 00000100:00100000:1.0:1787833954.718626:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367323136 00000100:00100000:1.0:1787833954.718726:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787833954.718740:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+13:14437:x1874679367323136:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787833954.718767:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833954.718788:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776270 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f6d expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.718894:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.718908:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.718920:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833954.718965:0:14446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787833954.718970:0:14446:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787833954.718994:0:14446:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.719006:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.719030:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776270 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f6d expref: 15 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.719046:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f6d expref: 14 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.719054:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:1.0:1787833954.719057:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833954.719060:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6000, rc 0) 00000100:00100000:1.0:1787833954.719131:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+14:14437:x1874679367323136:12345-192.168.202.15@tcp:101:bash.0 Request processed in 395us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833954.719138:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:3.0:1787833954.722320:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833954.723574:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367323392 00000100:00100000:0.0:1787833954.723593:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367323392 00000100:00100000:0.0:1787833954.723726:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787833954.723753:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+14:14437:x1874679367323392:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:0.0:1787833954.724246:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+15:14437:x1874679367323392:12345-192.168.202.15@tcp:35:bash.0 Request processed in 506us (1946us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787833954.724256:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787833954.826107:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833954.826450:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367323648 00000100:00100000:1.0:1787833954.826465:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367323648 00000100:00100000:1.0:1787833954.826562:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:1.0:1787833954.826576:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+15:14447:x1874679367323648:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787833954.826616:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833954.826644:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e77627e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833954.826801:0:14444:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787833954.826961:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e77627e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f74 expref: 17 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.826979:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b646021db00) 00010000:00010000:1.0:1787833954.826982:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833954.826989:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e77627e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f74 expref: 17 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.827009:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6200, rc 0) 00000100:00100000:1.0:1787833954.827149:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+16:14447:x1874679367323648:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 576us (1058us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787833954.827158:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:3.0:1787833954.831714:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833954.832183:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367323904 00000100:00100000:2.0:1787833954.832199:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367323904 00000100:00100000:2.0:1787833954.832484:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787833954.832499:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+16:14447:x1874679367323904:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787833954.833024:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+17:14447:x1874679367323904:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 526us (1323us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787833954.833032:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:1.0:1787833954.882812:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833954.883555:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367324160 00000100:00100000:2.0:1787833954.883571:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367324160 00000100:00100000:2.0:1787833954.883705:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:2.0:1787833954.883718:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477615e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+17:14450:x1874679367324160:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787833954.883764:0:16323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833954.883793:0:16323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77628c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f7b expref: -99 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.883917:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83a00/0x2bdb54ee5e776293 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.883936:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83a00/0x2bdb54ee5e776293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.883951:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83a00/0x2bdb54ee5e776293 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833954.883962:0:16323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787833954.884182:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82400/0x2bdb54ee5e77628c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f7b expref: 20 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.884209:0:16323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83a00/0x2bdb54ee5e776293 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f7b expref: 19 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.884217:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833954.884220:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833954.884225:0:16323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83a00, rc 0) 00000100:00100000:2.0:1787833954.884324:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477615e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+19:14450:x1874679367324160:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 609us (1523us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787833954.884333:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:1.0:1787833954.897399:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833954.897463:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833954.897506:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367324416 00000100:00100000:1.0:1787833954.897518:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367324416 00000100:00100000:1.0:1787833954.897603:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787833954.897617:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+19:2347:x1874679367324416:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787833954.897663:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787833954.897701:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83a00/0x2bdb54ee5e776293 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f7b expref: 19 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833954.897727:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:1.0:1787833954.897734:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787833954.897831:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+18:2347:x1874679367324416:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 217us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833954.897842:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:2.0:1787833954.898546:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367324288 00000100:00100000:2.0:1787833954.898574:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367324288 00000100:00100000:2.0:1787833954.898641:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:2.0:1787833954.898651:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64776152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14450:x1874679367324288:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787833954.898723:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.898740:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.898752:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.898782:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.898788:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.898795:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.898801:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833954.898805:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.898813:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.898826:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833954.898829:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787833954.898834:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833954.898850:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833954.898952:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64776152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14450:x1874679367324288:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 302us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833954.900520:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:0.0:1787833954.911614:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833954.912136:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367324672 00000100:00100000:3.0:1787833954.912150:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367324672 00000100:00100000:3.0:1787833954.912225:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:3.0:1787833954.912237:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14450:x1874679367324672:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787833954.912631:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+19:14450:x1874679367324672:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 394us (1030us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787833954.912641:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000001:00080000:1.0:1787833954.929646:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934601 is committed 00000001:00080000:1.0:1787833954.929677:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1787833954.929926:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934602 is committed 00000001:00080000:1.0:1787833954.929935:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1787833954.930035:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:1.0:1787833954.930045:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1787833955.068574:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833955.266687:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833955.266786:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367324928 00000100:00100000:2.0:1787833955.266800:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367324928 00000100:00100000:2.0:1787833955.266971:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787833955.266983:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477406d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+13:14481:x1874679367324928:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:2.0:1787833955.267021:0:16323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833955.267058:0:16323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f82 expref: -99 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.267195:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83400/0x2bdb54ee5e7762af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.267213:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83400/0x2bdb54ee5e7762af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.267229:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83400/0x2bdb54ee5e7762af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787833955.267242:0:16323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787833955.267477:0:16323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c82800/0x2bdb54ee5e7762a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f82 expref: 16 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.267504:0:16323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83400/0x2bdb54ee5e7762af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f82 expref: 15 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.267534:0:16323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833955.267538:0:16323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787833955.267542:0:16323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83400, rc 0) 00000100:00100000:2.0:1787833955.267633:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477406d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+15:14481:x1874679367324928:12345-192.168.202.15@tcp:101:cat.0 Request processed in 652us (963us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787833955.267641:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:3.0:1787833955.276451:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.276555:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367325184 00000100:00100000:0.0:1787833955.276567:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367325184 00000100:00100000:0.0:1787833955.276635:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787833955.276648:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+15:14481:x1874679367325184:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:0.0:1787833955.277260:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+16:14481:x1874679367325184:12345-192.168.202.15@tcp:35:cat.0 Request processed in 612us (821us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787833955.277269:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:3.0:1787833955.278046:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833955.278271:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367325312 00000100:00100000:2.0:1787833955.278279:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367325312 00000100:00100000:2.0:1787833955.278383:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:2.0:1787833955.278394:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+16:2344:x1874679367325312:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833955.278413:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833955.278448:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83400/0x2bdb54ee5e7762af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f82 expref: 16 pid: 16323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.278475:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833955.278482:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833955.278523:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477405680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+15:2344:x1874679367325312:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 131us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833955.278531:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:3.0:1787833955.355276:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.355497:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367325568 00000100:00100000:1.0:1787833955.355511:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367325568 00000100:00100000:1.0:1787833955.355598:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:1.0:1787833955.355609:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+15:14487:x1874679367325568:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:1.0:1787833955.355643:0:14445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833955.355672:0:14445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762bd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f89 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.355796:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.355812:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f66 expref: 16 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.355844:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f6d expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.355854:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.355898:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f6d expref: 16 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.355914:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f6d expref: 16 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.355931:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766f840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14445:1874679375699712:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833955.356199:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f66 expref: 16 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.356210:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f66 expref: 16 pid: 14445 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.356220:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14445:1874679375699840:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833955.356248:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6452d7e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787833955.364397:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.364452:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833955.364760:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367325696 00000100:00100000:2.0:1787833955.364773:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367325696 00010000:00010000:2.0:1787833955.364829:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f6d expref: 17 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833955.364884:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367325824 00000100:00100000:2.0:1787833955.364906:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367325824 00010000:00010000:2.0:1787833955.364926:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f66 expref: 18 pid: 14445 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833955.364944:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787833955.364956:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6442c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:2344:x1874679367325696:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833955.364976:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833955.364983:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f6d expref: 18 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.365000:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f6d expref: 18 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.365029:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833955.365035:0:14429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.365046:0:14429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.365063:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833955.365130:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6442c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:2344:x1874679367325696:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 176us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833955.365140:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787833955.365199:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:2.0:1787833955.365206:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+17:2345:x1874679367325824:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787833955.365213:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787833955.365218:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f66 expref: 17 pid: 14445 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.365234:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f66 expref: 17 pid: 14445 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.365247:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833955.365251:0:14429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.365260:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.365268:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.365290:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787833955.365310:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+17:2345:x1874679367325824:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 105us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833955.365317:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00010000:00010000:1.0:1787833955.366036:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e776277 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f6d expref: 16 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.366455:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766f840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14445:1874679375699712:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833955.366496:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776262 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f66 expref: 15 pid: 14445 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.366510:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14445:1874679375699840:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833955.366539:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.366551:0:14445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.366557:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833955.366584:0:14445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787833955.366809:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762bd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f89 expref: 16 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.366827:0:14445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7c00/0x2bdb54ee5e7762c4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f89 expref: 15 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.366836:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:1.0:1787833955.366838:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787833955.366841:0:14445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd7c00, rc 0) 00000100:00100000:1.0:1787833955.369623:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64623e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+15:14487:x1874679367325568:12345-192.168.202.15@tcp:101:dd.0 Request processed in 13997us (14355us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787833955.369641:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:0.0:1787833955.376120:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.376299:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367326080 00000100:00100000:1.0:1787833955.376313:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367326080 00000100:00100000:1.0:1787833955.376445:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:1.0:1787833955.376458:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+15:14487:x1874679367326080:12345-192.168.202.15@tcp:36:dd.0 00010000:00010000:1.0:1787833955.376808:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.376830:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.376845:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787833955.376906:0:14446:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787833955.376950:0:14446:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003280be22 reply state 000000008f5157f9 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.376961:0:14446:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787833955.377093:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462315a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14487:x1874679367326080:12345-192.168.202.15@tcp:36:dd.0 Request processed in 636us (987us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787833955.377102:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000020:00080000:1.0:1787833955.377108:0:14446:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787833955.379391:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.379414:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.379421:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.379425:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833955.379429:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.379454:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.379472:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833955.379475:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833955.379479:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.379484:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762d2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.380043:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833955.380284:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367326208 00000100:00100000:2.0:1787833955.380306:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367326208 00000100:00100000:2.0:1787833955.380446:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787833955.380458:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6462314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+17:14487:x1874679367326208:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:2.0:1787833955.380492:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787833955.380512:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83400/0x2bdb54ee5e7762d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f90 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.380575:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83400/0x2bdb54ee5e7762d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f90 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.380586:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83400/0x2bdb54ee5e7762d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f90 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.380600:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833955.380602:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833955.380605:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6476c83400, rc 0) 00000100:00100000:2.0:1787833955.380676:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6462314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14487:x1874679367326208:12345-192.168.202.15@tcp:101:dd.0 Request processed in 222us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833955.380683:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:3.0:1787833955.411777:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833955.428411:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367326464 00000100:00100000:2.0:1787833955.428438:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367326464 00000100:00100000:3.0:1787833955.429182:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787833955.429207:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14487:x1874679367326464:12345-192.168.202.15@tcp:103:dd.0 00010000:00010000:3.0:1787833955.429233:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787833955.429271:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83400/0x2bdb54ee5e7762d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f90 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.429300:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:3.0:1787833955.429307:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833955.429817:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f938780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+17:14487:x1874679367326464:12345-192.168.202.15@tcp:103:dd.0 Request processed in 612us (18055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833955.429827:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787833955.432733:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.433321:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367326592 00000100:00100000:1.0:1787833955.445096:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367326592 00000100:00100000:0.0:1787833955.445319:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:0.0:1787833955.445369:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+17:14487:x1874679367326592:12345-192.168.202.15@tcp:58:dd.0 00010000:00010000:0.0:1787833955.445551:0:16323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.445586:0:16323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.445603:0:16323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833955.449038:0:16323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787833955.449239:0:16323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787833955.449977:0:16323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787833955.450205:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+17:14487:x1874679367326592:12345-192.168.202.15@tcp:58:dd.0 Request processed in 4857us (17482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.450219:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:3.0:1787833955.453601:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.454313:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367326720 00000100:00100000:1.0:1787833955.454334:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367326720 00000100:00100000:1.0:1787833955.454447:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:1.0:1787833955.454462:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647f93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+17:14487:x1874679367326720:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:1.0:1787833955.454493:0:14444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833955.454521:0:14444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e7762e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f97 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.454625:0:14444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.454635:0:14444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e7762e7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f97 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.454652:0:14444:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.454663:0:14444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e7762e7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f97 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.454674:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:1.0:1787833955.454677:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787833955.454680:0:14444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e7762e7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f97 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.454685:0:14444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6000, rc 0) 00000100:00100000:1.0:1787833955.454770:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647f93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14487:x1874679367326720:12345-192.168.202.15@tcp:101:dd.0 Request processed in 311us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833955.454777:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000040:00080000:1.0:1787833955.457812:0:14477:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787833955.457824:0:14477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833955.457898:0:14477:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787833955.457906:0:14477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787833955.458075:0:14477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766d2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14477:1874679375699968:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787833955.458638:0:14477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64529b0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787833955.469557:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.469766:0:14477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766d2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14477:1874679375699968:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787833955.470243:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367326848 00000100:00100000:3.0:1787833955.470254:0:14455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367326848 00000100:00100000:3.0:1787833955.470390:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:3.0:1787833955.470403:0:14455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460345680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14489:x1874679367326848:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787833955.470531:0:14455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460345680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14489:x1874679367326848:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 Request processed in 130us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833955.470540:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:3.0:1787833955.475179:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.475315:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367326976 00000100:00100000:1.0:1787833955.475394:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367326976 00000100:00100000:1.0:1787833955.475474:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:1.0:1787833955.475488:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14489:x1874679367326976:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787833955.475535:0:14446:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787833955.475732:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14489:x1874679367326976:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 247us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833955.475741:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787833955.501469:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.501648:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367327104 00000100:00100000:1.0:1787833955.501662:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367327104 00000100:00100000:1.0:1787833955.501745:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:1.0:1787833955.501757:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14489:x1874679367327104:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787833955.501860:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.501895:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.501911:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.504896:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.504924:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.504939:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.504996:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.505006:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.505016:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833955.509488:0:14444:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787833955.509507:0:14444:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833955.509544:0:14444:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509567:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509576:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509586:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509592:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833955.509597:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509641:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509663:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:0.0:1787833955.509666:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833955.509671:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509677:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e7762ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509704:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509710:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509717:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509721:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd7a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833955.509724:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509730:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509738:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b6442c99a00) 00010000:00010000:0.0:1787833955.509741:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833955.509745:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509762:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e7762f5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509784:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509790:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509795:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509800:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833955.509803:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509808:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509816:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:0.0:1787833955.509818:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833955.509822:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.509827:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e7762fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.510047:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14489:x1874679367327104:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 8285us (8585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.510061:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:2.0:1787833955.531504:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.533154:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367327360 00000100:00100000:1.0:1787833955.533168:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367327360 00000100:00100000:1.0:1787833955.533249:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:1.0:1787833955.533259:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460344780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14489:x1874679367327360:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833955.533280:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833955.533300:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776303 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3f9e expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533460:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533476:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533487:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787833955.533500:0:14446:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787833955.533605:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533630:0:14446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533638:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533645:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833955.533650:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533658:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533671:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:1.0:1787833955.533675:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787833955.533679:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533686:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77630a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533735:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776303 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f9e expref: 20 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533745:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6474279f00) 00010000:00010000:1.0:1787833955.533748:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787833955.533751:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776303 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f9e expref: 20 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.533761:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6200, rc 0) 00000100:00100000:1.0:1787833955.533839:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460344780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+19:14489:x1874679367327360:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 582us (2352us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787833955.533848:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:3.0:1787833955.537213:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.537462:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367327488 00000100:00100000:0.0:1787833955.537482:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367327488 00000100:00100000:0.0:1787833955.537572:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:0.0:1787833955.537584:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+19:14489:x1874679367327488:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787833955.537624:0:14445:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787833955.537782:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+19:14489:x1874679367327488:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 200us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.537791:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:2.0:1787833955.545944:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.546090:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367327744 00000100:00100000:1.0:1787833955.546103:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367327744 00000100:00100000:1.0:1787833955.546177:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:1.0:1787833955.546188:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+19:14489:x1874679367327744:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833955.546215:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833955.546237:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776318 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3fa5 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787833955.547200:0:14446:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1787833955.547210:0:14446:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787833955.547261:0:14446:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787833955.547668:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77631f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.547686:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77631f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.547698:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77631f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.547774:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776318 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fa5 expref: 22 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.547793:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77631f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fa5 expref: 21 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.547817:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99b00) 00010000:00010000:1.0:1787833955.547820:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787833955.547824:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6600, rc 0) 00000100:00100000:1.0:1787833955.547903:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+21:14489:x1874679367327744:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1716us (1970us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787833955.547911:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787833955.555471:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.555661:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367328000 00000100:00100000:0.0:1787833955.555679:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367328000 00000100:00100000:0.0:1787833955.555761:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:0.0:1787833955.555773:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6479ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+21:14489:x1874679367328000:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833955.555842:0:14445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833955.555872:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6600/0x2bdb54ee5e77631f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fa5 expref: 21 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.555892:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99b00) 00010000:00010000:0.0:1787833955.555904:0:14445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833955.555932:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.555946:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.555956:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.555998:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556023:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556029:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556308:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556316:0:14445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556322:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556328:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c4600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833955.556333:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556407:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556419:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b646021df00) 00010000:00010000:0.0:1787833955.556423:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833955.556427:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556434:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e77632d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556446:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556460:0:14445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556466:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556470:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c4a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:0.0:1787833955.556473:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556480:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556487:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x1aa1320b (ffff9b646021d600) 00010000:00010000:0.0:1787833955.556490:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787833955.556493:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.556499:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776334 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1aa1320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.556620:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6479ef6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+20:14489:x1874679367328000:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 848us (1165us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787833955.556629:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:3.0:1787833955.560520:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.561096:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367328128 00000100:00100000:1.0:1787833955.561113:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367328128 00000100:00100000:1.0:1787833955.561194:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787833955.561204:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+20:14489:x1874679367328128:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833955.561228:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833955.561255:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e77633b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3fac expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.561304:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e776342 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.561320:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e776342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.561383:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e776342 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.561515:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e77633b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fac expref: 22 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.561538:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd7a00/0x2bdb54ee5e776342 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fac expref: 21 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.561559:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99100) 00010000:00010000:1.0:1787833955.561561:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787833955.561566:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd7a00, rc 0) 00000100:00100000:1.0:1787833955.561650:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+21:14489:x1874679367328128:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 447us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833955.561657:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:3.0:1787833955.567679:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.569406:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367328384 00000100:00100000:0.0:1787833955.569433:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367328384 00000100:00100000:0.0:1787833955.569597:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:0.0:1787833955.569611:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+21:14489:x1874679367328384:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833955.569726:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.569779:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.569794:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787833955.570482:0:14445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1787833955.570500:0:14445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434326158332ns, next at 435326154965ns, rc = 0 00000004:00010000:0.0:1787833955.570633:0:14445:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f54f873a reply state 00000000aa539c3b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.570646:0:14445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833955.571945:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+23:14489:x1874679367328384:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 2323us (4267us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787833955.571960:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00010000:00010000:1.0:1787833955.576087:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.576108:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.576120:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833955.576130:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:1.0:1787833955.576135:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c4a00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:1.0:1787833955.576143:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.576162:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.576213:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367328512 00000100:00100000:0.0:1787833955.576223:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367328512 00000100:00100000:0.0:1787833955.576288:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:0.0:1787833955.576298:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+23:14489:x1874679367328512:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833955.576332:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99100) 00010000:00010000:1.0:1787833955.576362:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787833955.576368:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.576374:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4a00/0x2bdb54ee5e776349 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.576426:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833955.576615:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3fb3 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.576681:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fb3 expref: 24 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.576696:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fb3 expref: 24 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.576739:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99100) 00010000:00010000:0.0:1787833955.576742:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787833955.576745:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b64821c4600, rc 0) 00000100:00100000:0.0:1787833955.576817:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+24:14489:x1874679367328512:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 520us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.576824:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:2.0:1787833955.581173:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833955.581489:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367328640 00000100:00100000:3.0:1787833955.581505:0:15128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367328640 00000100:00100000:3.0:1787833955.581608:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787833955.581622:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460345a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2344:x1874679367328640:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787833955.582436:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460345a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+6:2344:x1874679367328640:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 810us (1272us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787833955.582450:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00080000:2.0:1787833955.582951:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787833955.585751:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.585938:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367328896 00000100:00100000:0.0:1787833955.585953:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367328896 00000100:00100000:0.0:1787833955.586031:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787833955.586044:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+23:14489:x1874679367328896:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787833955.586631:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+24:14489:x1874679367328896:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 586us (903us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787833955.586640:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787833955.589623:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833955.589798:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367329152 00000100:00100000:2.0:1787833955.589811:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367329152 00000100:00100000:2.0:1787833955.589884:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787833955.589895:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+24:14489:x1874679367329152:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787833955.590033:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+24:14489:x1874679367329152:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 139us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833955.590042:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:3.0:1787833955.593592:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.593773:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367329280 00000100:00100000:0.0:1787833955.593785:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367329280 00000100:00100000:0.0:1787833955.593869:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787833955.593881:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+24:14489:x1874679367329280:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787833955.593913:0:14446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787833955.593941:0:14446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776357 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3fba expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.594027:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e77635e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.594045:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e77635e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.594219:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e77635e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787833955.594270:0:14446:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787833955.594289:0:14446:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e77635e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14446 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.594510:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e776357 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fba expref: 26 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.594534:0:14446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e77635e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fba expref: 25 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.594543:0:14446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99100) 00010000:00010000:0.0:1787833955.594546:0:14446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787833955.594550:0:14446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b64821c5200, rc 0) 00000100:00100000:0.0:1787833955.594672:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+25:14489:x1874679367329280:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 793us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.594682:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787833955.599991:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.600177:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367329408 00000100:00100000:1.0:1787833955.600191:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367329408 00000100:00100000:1.0:1787833955.600318:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:1.0:1787833955.600330:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+6:2347:x1874679367329408:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787833955.600392:0:15130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787833955.600422:0:15130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3fc1 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787833955.600462:0:15130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a902e63, blocks: 0x1 00010000:00010000:1.0:1787833955.600489:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787833955.600495:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833955.600507:0:15130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc1 expref: 7 pid: 15130 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.600531:0:15130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc1 expref: 7 pid: 15130 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.600548:0:15130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b647fcd6200, rc 0) 00000100:00100000:1.0:1787833955.600630:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+7:2347:x1874679367329408:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 302us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833955.600639:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787833955.605964:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.606140:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367329664 00000100:00100000:0.0:1787833955.606153:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367329664 00000100:00100000:0.0:1787833955.606444:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:0.0:1787833955.606458:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460346580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+25:14489:x1874679367329664:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787833955.606610:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460346580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+25:14489:x1874679367329664:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 155us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.606620:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:2.0:1787833955.610018:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833955.610134:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367329792 00000100:00100000:3.0:1787833955.610147:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367329792 00000100:00100000:3.0:1787833955.610236:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:3.0:1787833955.610248:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460344f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+25:14489:x1874679367329792:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787833955.659040:0:5838:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787833955.659066:0:5838:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787833955.659648:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787833955.659693:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375700096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787833955.659796:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787833955.659877:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375700096 00000100:00100000:1.0:1787833955.659886:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375700096 00000100:00100000:1.0:1787833955.659961:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787833955.659972:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375700096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787833955.660497:0:15131:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787833955.660503:0:15131:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787833955.660505:0:15131:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787833955.660508:0:15131:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787833955 -> 1787833955 00002000:00010000:1.0:1787833955.660510:0:15131:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787833955.660582:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1874679375700096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 610us (784us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787833955.660591:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787833955.660620:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787833955.660796:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460344f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+14:14489:x1874679367329792:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 50483us (50726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833955.660807:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000004:00080000:3.0:1787833955.663544:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b647766f840/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787833955.663564:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375700096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787833955.663692:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.664422:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367329920 00000100:00100000:1.0:1787833955.664432:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367329920 00000100:00100000:1.0:1787833955.664499:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787833955.664511:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+7:2344:x1874679367329920:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787833955.664658:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+7:2344:x1874679367329920:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 148us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833955.664666:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787833955.667772:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.667894:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367330176 00000100:00100000:0.0:1787833955.667906:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367330176 00000100:00100000:0.0:1787833955.667978:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:0.0:1787833955.667989:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+14:14489:x1874679367330176:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787833955.668062:0:14445:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833955.668099:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5200/0x2bdb54ee5e77635e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fba expref: 14 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.668126:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99100) 00010000:00010000:0.0:1787833955.668133:0:14445:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787833955.668187:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.668206:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.668220:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787833955.668553:0:14445:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed5b27b8 reply state 00000000dfb33cb2 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.668565:0:14445:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787833955.668699:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+15:14489:x1874679367330176:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 711us (940us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787833955.668708:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:1.0:1787833955.672829:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833955.672959:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367330304 00000100:00100000:3.0:1787833955.672972:0:15128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367330304 00000100:00100000:3.0:1787833955.673048:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:3.0:1787833955.673060:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+7:14489:x1874679367330304:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787833955.673087:0:15128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787833955.673112:0:15128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e4760b92cfe3fc8 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.673167:0:15128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc1 expref: 8 pid: 15130 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.673179:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833955.673184:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833955.673190:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 8 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.673235:0:15128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc1 expref: 8 pid: 15130 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.673251:0:15128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc1 expref: 8 pid: 15130 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833955.673279:0:15128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6341fa92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15128:1874679375700224:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787833955.673459:0:15128:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647f9b0a80 going to sleep for 11 seconds 00010000:00010000:2.0:1787833955.674312:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.674329:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.674366:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.674372:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c4c00 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833955.674394:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.674403:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.674427:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99100) 00010000:00010000:2.0:1787833955.674430:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833955.674436:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.674443:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4c00/0x2bdb54ee5e77636c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833955.679694:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.679803:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367330432 00000100:00100000:0.0:1787833955.679816:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367330432 00010000:00010000:0.0:1787833955.679874:0:14431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc1 expref: 9 pid: 15130 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.679952:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:0.0:1787833955.679964:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+9:2346:x1874679367330432:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833955.679985:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833955.680019:0:14431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc1 expref: 9 pid: 15130 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.680036:0:14431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc1 expref: 9 pid: 15130 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.680073:0:14431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833955.680078:0:14431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833955.680087:0:14431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 9 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.680100:0:14431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 9 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.680149:0:14431:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 9 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.680178:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14431:1874679375700352:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787833955.680302:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477a60cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787833955.684754:0:15128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e776365 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc1 expref: 9 pid: 15130 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.684789:0:15128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6341fa92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15128:1874679375700224:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833955.684840:0:15128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 8 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.684858:0:15128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6479dd3a00, rc 0) 00000100:00100000:0.0:1787833955.685237:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14431:1874679375700352:192.168.202.15@tcp:105: 00000100:00100000:1.0:1787833955.685630:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+8:14489:x1874679367330304:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 12570us (12815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833955.685642:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787833955.688920:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:0.0:1787833955.689079:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787833955.689325:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367330560 00000100:00100000:3.0:1787833955.689395:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367330560 00000100:00100000:3.0:1787833955.689474:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787833955.689488:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6460347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+8:2345:x1874679367330560:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787833955.689785:0:15131:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787833955.689790:0:15131:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787833955 00002000:00010000:3.0:1787833955.689793:0:15131:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787833954 00002000:00010000:3.0:1787833955.689796:0:15131:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787833955 -> 1787833955 00002000:00010000:3.0:1787833955.689798:0:15131:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787833955.689971:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+9:2346:x1874679367330432:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 10006us (10290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.689985:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787833955.691205:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6460347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+8:2345:x1874679367330560:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 1708us (2289us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787833955.691219:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:2.0:1787833955.695724:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.695904:0:15128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367330688 00000100:00100000:1.0:1787833955.695918:0:15128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367330688 00000100:00100000:1.0:1787833955.696028:0:15128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:1.0:1787833955.696041:0:15128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b64603452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+8:2344:x1874679367330688:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787833955.696107:0:15128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.696134:0:15128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 8 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.696145:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833955.696150:0:15128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787833955.696165:0:15128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.696233:0:15128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 8 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.696250:0:15128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 8 pid: 15128 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.696269:0:15128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15128:1874679375700480:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833955.696465:0:15128:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64509140c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833955.699460:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.699561:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367330816 00000100:00100000:0.0:1787833955.699574:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367330816 00010000:00010000:0.0:1787833955.699626:0:14429:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 9 pid: 15128 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.699679:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787833955.699691:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+9:2344:x1874679367330816:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833955.699710:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833955.699755:0:14429:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 9 pid: 15128 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.699774:0:14429:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 9 pid: 15128 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.699808:0:14429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833955.699813:0:14429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787833955.699819:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.699831:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.699879:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833955.699955:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+9:2344:x1874679367330816:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 265us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.699964:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00010000:00010000:1.0:1787833955.700469:0:15128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000da8e79b/0x2bdb54ee5e776373 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fc8 expref: 8 pid: 15128 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.700489:0:15128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15128:1874679375700480:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833955.700519:0:15128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.700530:0:15128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.700537:0:15128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.700569:0:15128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.700594:0:15128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.700602:0:15128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.700610:0:15128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833955.700615:0:15128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.700624:0:15128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.700637:0:15128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.700645:0:15128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e77637a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.700704:0:15128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b64603452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+7:2344:x1874679367330688:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 4667us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833955.700712:0:15128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787833955.705143:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.705468:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367331072 00000100:00100000:1.0:1787833955.705482:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367331072 00000100:00100000:1.0:1787833955.705558:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:1.0:1787833955.705592:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+14:14489:x1874679367331072:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787833955.705710:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.705873:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.705892:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.706618:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.706639:0:14444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fb3 expref: 15 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.706649:0:14444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.706703:0:14444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fb3 expref: 15 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.706720:0:14444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fb3 expref: 15 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833955.706816:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647766e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14444:1874679375700608:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787833955.707006:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b64509140c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787833955.711722:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833955.711866:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647766e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14444:1874679375700608:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787833955.711908:0:14444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.713014:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367331200 00000100:00100000:0.0:1787833955.713027:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367331200 00010000:00010000:0.0:1787833955.713084:0:14431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fb3 expref: 16 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787833955.713138:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787833955.713161:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+16:2345:x1874679367331200:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787833955.713183:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787833955.713191:0:14431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fb3 expref: 16 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.713205:0:14431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fb3 expref: 16 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.713232:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776350 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3fb3 expref: 16 pid: 14446 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.713251:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99100) 00010000:00010000:0.0:1787833955.713257:0:14431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.713294:0:14431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.713310:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.713504:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787833955.713587:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+15:2345:x1874679367331200:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 438us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.713596:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00010000:00010000:1.0:1787833955.717237:0:14444:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833955.717259:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833955.718008:0:14444:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787833955.718266:0:14444:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787833955.718858:0:14444:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787833955.718998:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14444:1874679375700736:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787833955.722736:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833955.722791:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477a606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787833955.722895:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375700736 00000100:00100000:1.0:1787833955.722911:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375700736 00000100:00100000:1.0:1787833955.722983:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787833955.722996:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14444:x1874679375700736:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787833955.723175:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14444:x1874679375700736:12345-0@lo:1000:mdt00_000.0 Request processed in 182us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787833955.723186:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787833955.723220:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14444:1874679375700736:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787833955.724500:0:14444:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787833955.725086:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14444:1874679375700864:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787833955.725679:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833955.725726:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b6477a60cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833955.725975:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375700864 00000100:00100000:2.0:1787833955.725990:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375700864 00000100:00100000:2.0:1787833955.726068:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833955.726080:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14444:x1874679375700864:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787833955.727215:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14444:x1874679375700864:12345-0@lo:1000:mdt00_000.0 Request processed in 1129us (1530us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787833955.727230:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787833955.727447:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14444:1874679375700864:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787833955.727498:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727508:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727515:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727519:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6800 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833955.727541:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727548:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727564:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99100) 00010000:00010000:2.0:1787833955.727566:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833955.727570:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727574:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6800/0x2bdb54ee5e776388 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727674:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727680:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727683:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727723:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c5400 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833955.727725:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727770:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727778:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833955.727779:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787833955.727791:0:14444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e7762e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f97 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727802:0:14444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e7762e7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f97 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727809:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e7762e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f97 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.727872:0:14444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6000/0x2bdb54ee5e7762e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x3e4760b92cfe3f97 expref: 18 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833955.727885:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14444:1874679375700992:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787833955.727985:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b647f9820c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787833955.731106:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14444:1874679375700992:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787833955.731164:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731176:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c5400/0x2bdb54ee5e7762e0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731220:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731237:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731252:0:14444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731286:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731305:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731312:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731318:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83600 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833955.731322:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731330:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731387:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833955.731390:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787833955.731394:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731400:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6476c83600/0x2bdb54ee5e77638f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731413:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731418:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731424:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731435:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6200 already unused, calling callback (ffffffffc22274f0) 00010000:00010000:2.0:1787833955.731438:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731444:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731452:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b646021dc00) 00010000:00010000:2.0:1787833955.731454:0:14444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787833955.731457:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833955.731462:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b647fcd6200/0x2bdb54ee5e776381 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14444 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833955.731765:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14489:x1874679367331072:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 26174us (26633us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787833955.731777:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000020:00080000:2.0:1787833955.731785:0:14444:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787833955.732040:0:14477:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787833955.732046:0:14477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787833955.732078:0:14477:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787833955.732086:0:14477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787833955.734960:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833955.735068:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367331456 00000100:00100000:0.0:1787833955.735083:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367331456 00000100:00100000:0.0:1787833955.735166:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787833955.735177:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6452361050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+18:14489:x1874679367331456:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787833955.735968:0:14448:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787833955.736076:0:14448:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787833955.736118:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.736134:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.736144:0:14448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.736152:0:14448:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.736157:0:14448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.736163:0:14448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833955.736186:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787833955.736300:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6452361050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+20:14489:x1874679367331456:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1122us (1351us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787833955.736309:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000020:00080000:0.0:1787833955.736316:0:14448:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787833955.737236:0:16566:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787833955.737253:0:16566:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.737394:0:16566:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c4600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833955.737400:0:16566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.737414:0:16566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.737438:0:16566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6442c99100) 00010000:00010000:3.0:1787833955.737442:0:16566:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787833955.737448:0:16566:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.737478:0:16566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b64821c4600/0x2bdb54ee5e776396 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833955.737498:0:16566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833955.737500:0:16566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787833955.737502:0:16566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787833955.738539:0:3275:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833955.739656:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367331584 00000100:00100000:2.0:1787833955.739673:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367331584 00000100:00100000:2.0:1787833955.739742:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787833955.739754:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+20:14487:x1874679367331584:12345-192.168.202.15@tcp:49:dd.0 00000100:00100000:2.0:1787833955.739955:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+20:14487:x1874679367331584:12345-192.168.202.15@tcp:49:dd.0 Request processed in 203us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833955.739964:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787833955.900699:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787833955.900800:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787833955.900831:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375701248:0@lo:400:kworker.0 00000100:00100000:3.0:1787833955.900967:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833955.901130:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375701248 00000100:00100000:3.0:1787833955.901140:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375701248 00000100:00100000:3.0:1787833955.901229:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787833955.901242:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375701248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787833955.901323:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1874679375701248:12345-0@lo:400:kworker.0 Request processed in 84us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833955.901373:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787833955.901427:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1874679375701248:0@lo:400:kworker.0 00000100:00100000:0.0:1787833955.904197:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787833955.904224:0:3281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375701376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787833955.904324:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787833955.904453:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787833955.909073:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375701376 00000100:00100000:3.0:1787833955.909093:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375701376 00000100:00100000:3.0:1787833955.909196:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787833955.909207:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375701376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787833955.909258:0:15133:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833955.909757:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1874679375701376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 549us (5430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833955.909767:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787833955.911008:0:3281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1874679375701376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787833955.914510:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375701120:0@lo:400:kworker.0 00000100:00100000:1.0:1787833955.914628:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833955.915117:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375701120 00000100:00100000:3.0:1787833955.915128:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375701120 00000100:00100000:3.0:1787833955.915212:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787833955.915224:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3283:x1874679375701120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833955.916505:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787833955.916533:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b6477614780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375701504:0@lo:400:kworker.0 00000100:00100000:2.0:1787833955.916627:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833955.916683:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375701504 00000100:00100000:2.0:1787833955.916690:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375701504 00000100:00100000:2.0:1787833955.917643:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787833955.917661:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375701504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833955.917769:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1874679375701504:12345-0@lo:400:kworker.0 Request processed in 114us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833955.917778:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787833955.917840:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1874679375701504:0@lo:400:kworker.0 00000100:00100000:3.0:1787833955.918206:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9+19:3283:x1874679375701120:12345-0@lo:400:kworker.0 Request processed in 2981us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833955.918217:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787833955.918311:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647745da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375701632:0@lo:400:kworker.0 00000100:00100000:1.0:1787833955.918376:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b6477614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7c35a64-fd0d-40a9-a3ec-803aa4efddc9:3283:1874679375701120:0@lo:400:kworker.0 00000100:00100000:1.0:1787833955.920397:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b647745cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375701760:0@lo:400:kworker.0 00000100:00100000:3.0:1787833955.921682:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787833955.921936:0:16323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375701632 00000100:00100000:0.0:1787833955.921947:0:16323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375701632 00000100:00100000:0.0:1787833955.922042:0:16323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787833955.922055:0:16323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375701632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787833955.922140:0:16323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874679375701632:12345-0@lo:400:kworker.0 Request processed in 89us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833955.922148:0:16323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787833955.922431:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787833955.922646:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647745da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1874679375701632:0@lo:400:kworker.0 00000100:00100000:1.0:1787833955.923142:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787833955.923491:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375701760 00000100:00100000:2.0:1787833955.923499:0:14445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375701760 00000100:00100000:2.0:1787833955.923608:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787833955.923618:0:14445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375701760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787833955.923695:0:14445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874679375701760:12345-0@lo:400:kworker.0 Request processed in 80us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787833955.923703:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787833955.923848:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b647745cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1874679375701760:0@lo:400:kworker.0 00000100:00080000:0.0:1787833955.924434:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787833956.031863:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833956.031922:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833956.031956:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787833956.032007:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833956.032040:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367331712 00000100:00100000:0.0:1787833956.032056:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367331712 00000100:00100000:0.0:1787833956.032132:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367331840 00000100:00100000:0.0:1787833956.032135:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367331840 00000100:00100000:0.0:1787833956.032152:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367331968 00000100:00100000:0.0:1787833956.032155:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367331968 00000100:00100000:0.0:1787833956.032168:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367332096 00000100:00100000:0.0:1787833956.032171:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367332096 00000100:00100000:0.0:1787833956.032192:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:0.0:1787833956.032204:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+10:2345:x1874679367331712:12345-192.168.202.15@tcp:4:dd.0 00002000:00010000:0.0:1787833956.032275:0:15135:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a902e63, atime: 0x6a902e62, ctime: 0x6a902e63, blocks: 0x1 00010000:00010000:0.0:1787833956.032289:0:15135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833956.032311:0:15135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=434s v=(0 0) 00010000:00010000:0.0:1787833956.032316:0:15135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787833956.032325:0:15135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787833956.032390:0:15135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833956.040408:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787833956.040544:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833956.047313:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787833956.048095:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833956.048176:0:15136:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787833956.057475:0:15134:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787833956.057904:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367332224 00000100:00100000:1.0:1787833956.057919:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367332224 00000100:00100000:1.0:1787833956.058023:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787833956.058037:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367332480 00000100:00100000:1.0:1787833956.058041:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367332480 00000100:00100000:0.0:1787833956.063477:0:15136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367332352 00000100:00100000:0.0:1787833956.063505:0:15136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367332352 00000100:00100000:1.0:1787833956.064095:0:3273:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787833956.064159:0:15134:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787833956.064174:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367332608 00000100:00100000:1.0:1787833956.064178:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367332608 00000100:00100000:2.0:1787833956.066322:0:16681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:2.0:1787833956.066386:0:16681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647745da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+15:2344:x1874679367331840:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:2.0:1787833956.066449:0:16681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.066487:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833956.066492:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833956.066502:0:16681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.066522:0:16681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.100582:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787833956.190096:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00002000:00010000:1.0:1787833956.190247:0:15135:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1787833956.190257:0:15135:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787833955 -> 1787833956 00002000:00010000:1.0:1787833956.190259:0:15135:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787833955 -> 1787833956 00002000:00010000:1.0:1787833956.190263:0:15135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1787833956.190279:0:15135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.190304:0:15135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.190315:0:15135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.190323:0:15135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b64821c4600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833956.190337:0:15135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.190404:0:15135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787833956.190598:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1787833956.190616:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1787833956.190624:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00010000:00010000:3.0:1787833956.191513:0:16681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.191535:0:16681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.191546:0:16681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.191554:0:16681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833956.191560:0:16681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.191598:0:16681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.191621:0:16681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.191630:0:16681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d23431b/0x2bdb54ee5e7763a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.194070:0:15135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.194109:0:15135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe756230/0x2bdb54ee5e77639d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833956.195081:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+12:2345:x1874679367331712:12345-192.168.202.15@tcp:4:dd.0 Request processed in 162870us (163238us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787833956.195098:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787833956.195138:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787833956.195151:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+11:2344:x1874679367331968:12345-192.168.202.15@tcp:4:dd.0 00002000:00010000:1.0:1787833956.195280:0:15135:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a902e64, atime: 0x6a902e62, ctime: 0x6a902e64, blocks: 0x1007 00010000:00010000:1.0:1787833956.195294:0:15135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.195311:0:15135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=434s v=(0 0) 00010000:00010000:1.0:1787833956.195316:0:15135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833956.195322:0:15135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.195864:0:15135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833956.199037:0:16681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647745da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+12:2344:x1874679367331840:12345-192.168.202.15@tcp:4:dd.0 Request processed in 132642us (167093us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787833956.199132:0:16681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:2.0:1787833956.199264:0:16681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:2.0:1787833956.199288:0:16681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+11:2344:x1874679367332096:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:2.0:1787833956.199376:0:16681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.199464:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833956.199471:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833956.199480:0:16681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.199500:0:16681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833956.345612:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1787833956.345889:0:15135:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:3.0:1787833956.345895:0:15135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1787833956.345911:0:15135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.345924:0:15135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.345934:0:15135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.348515:0:15135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833956.348523:0:15135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.348537:0:15135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.348585:0:15135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.348594:0:15135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833956.348714:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+13:2344:x1874679367331968:12345-192.168.202.15@tcp:4:dd.0 Request processed in 153562us (316750us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787833956.348730:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787833956.348767:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787833956.348793:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341faa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+12:2345:x1874679367332224:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:3.0:1787833956.348827:0:15135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.348841:0:15135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787833956.348845:0:15135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787833956.348851:0:15135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.348863:0:15135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833956.424302:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1787833956.432991:0:16681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1787833956.433003:0:16681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:2.0:1787833956.433025:0:16681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.433042:0:16681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.433052:0:16681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.433060:0:16681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c83e00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:2.0:1787833956.433065:0:16681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.433075:0:16681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.433101:0:16681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.433110:0:16681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0cb81d2/0x2bdb54ee5e7763b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787833956.433262:0:16681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477614780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+12:2344:x1874679367332096:12345-192.168.202.15@tcp:4:dd.0 Request processed in 233979us (401246us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787833956.433275:0:16681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:2.0:1787833956.433336:0:16681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787833956.434159:0:16681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+11:2345:x1874679367332480:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:2.0:1787833956.434213:0:16681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.434231:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833956.434237:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787833956.434245:0:16681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787833956.434261:0:16681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787833956.510904:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:1.0:1787833956.514403:0:15135:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:1.0:1787833956.514420:0:15135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1787833956.514445:0:15135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.514488:0:15135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.514497:0:15135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.514505:0:15135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6479dd2400 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833956.515235:0:15135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.515250:0:15135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.515279:0:15135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.515288:0:15135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009eab63d5/0x2bdb54ee5e7763b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833956.515479:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341faa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+11:2345:x1874679367332224:12345-192.168.202.15@tcp:4:dd.0 Request processed in 166695us (475089us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787833956.515493:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:1.0:1787833956.515817:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:1.0:1787833956.515834:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6341fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+10:2345:x1874679367332352:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:1.0:1787833956.515885:0:15135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.515915:0:15135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833956.515921:0:15135:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833956.515929:0:15135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.515945:0:15135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787833956.574057:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00010000:00010000:1.0:1787833956.574628:0:16681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.574648:0:16681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.574657:0:16681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.574667:0:16681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6476c82e00 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833956.574673:0:16681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.574684:0:16681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.574712:0:16681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.574760:0:16681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f129a86/0x2bdb54ee5e7763c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833956.574900:0:16681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+10:2345:x1874679367332480:12345-192.168.202.15@tcp:4:dd.0 Request processed in 141505us (534346us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787833956.574912:0:16681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:1.0:1787833956.574957:0:16681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787833956.574972:0:16681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b647766da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+9:2345:x1874679367332608:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:1.0:1787833956.575017:0:16681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.575033:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833956.575038:0:16681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787833956.575047:0:16681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.575063:0:16681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787833956.631066:0:15135:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1787833956.631083:0:15135:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1787833956.631104:0:15135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.631121:0:15135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.631157:0:15135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.631165:0:15135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6200 already unused, calling callback (ffffffffc1809500) 00010000:00010000:1.0:1787833956.631170:0:15135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.631181:0:15135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.631208:0:15135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787833956.631217:0:15135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040913e0f/0x2bdb54ee5e7763c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787833956.631505:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6341fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4865fa16-b0dc-4920-8df4-908aff1ec664+11:2345:x1874679367332352:12345-192.168.202.15@tcp:4:dd.0 Request processed in 115670us (583410us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787833956.631518:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000001:00080000:3.0:1787833956.634016:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1787833956.679865:0:16681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1787833956.679912:0:16681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.679929:0:16681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.679939:0:16681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.679948:0:16681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b647fcd6600 already unused, calling callback (ffffffffc1809500) 00010000:00010000:3.0:1787833956.679954:0:16681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.679964:0:16681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.679992:0:16681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787833956.680000:0:16681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd40de43/0x2bdb54ee5e7763ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787833956.680156:0:16681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b647766da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4865fa16-b0dc-4920-8df4-908aff1ec664+7:2345:x1874679367332608:12345-192.168.202.15@tcp:4:dd.0 Request processed in 105181us (616063us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787833956.680169:0:16681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000001:00080000:1.0:1787833956.680597:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1787833957.116592:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787833958.067652:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833958.067694:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833958.067715:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833958.067748:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833958.067771:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833958.067793:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833958.067817:0:3274:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787833958.067849:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367333120 00000100:00100000:0.0:1787833958.067863:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367333120 00000100:00100000:0.0:1787833958.067935:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367333376 00000100:00100000:0.0:1787833958.067938:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367333376 00000100:00100000:0.0:1787833958.067953:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367332992 00000100:00100000:0.0:1787833958.067955:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367332992 00000100:00100000:0.0:1787833958.067969:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367333504 00000100:00100000:0.0:1787833958.067971:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367333504 00000100:00100000:0.0:1787833958.067988:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787833958.067999:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2344:x1874679367333120:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833958.068096:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2344:x1874679367333120:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 99us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833958.068105:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787833958.068123:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787833958.068144:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2344:x1874679367333376:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833958.068171:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2344:x1874679367333376:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833958.068178:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787833958.068257:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787833958.068266:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2344:x1874679367332992:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833958.068291:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4865fa16-b0dc-4920-8df4-908aff1ec664+5:2344:x1874679367332992:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833958.068297:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787833958.068307:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787833958.068324:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2344:x1874679367333504:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833958.068378:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4b79920-a7bc-4762-befe-a82a11d15d6c+5:2344:x1874679367333504:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 64us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833958.068385:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787833958.068406:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367332736 00000100:00100000:0.0:1787833958.068410:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367332736 00000100:00100000:0.0:1787833958.068435:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:0.0:1787833958.068441:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6450d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:2344:x1874679367332736:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833958.068465:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6450d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54ea64ce-9f56-4ecd-b929-99c45af8c173+13:2344:x1874679367332736:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833958.068472:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:0.0:1787833958.068508:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367332864 00000100:00100000:0.0:1787833958.068511:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367332864 00000100:00100000:0.0:1787833958.068542:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679367333248 00000100:00100000:0.0:1787833958.068552:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679367333248 00000100:00100000:0.0:1787833958.068578:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:0.0:1787833958.068584:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+20:2344:x1874679367332864:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833958.068619:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4865fa16-b0dc-4920-8df4-908aff1ec664+20:2344:x1874679367332864:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833958.068626:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:0.0:1787833958.068638:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:0.0:1787833958.068644:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b646e1a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2344:x1874679367333248:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787833958.068667:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b646e1a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4b79920-a7bc-4762-befe-a82a11d15d6c+6:2344:x1874679367333248:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787833958.068673:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00080000:0.0:1787833958.068689:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787833958.068695:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787833958.068697:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787833958.143507:0:16566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787833958.381907:0:16719:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1787833958.972746:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b646e1a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375701888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787833958.972857:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787833958.975111:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874679375701888 00000100:00100000:3.0:1787833958.975129:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874679375701888 00000100:00100000:3.0:1787833958.975249:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787833958.975264:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6477404f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375701888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787833958.975335:0:15133:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787833958.975475:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6477404f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1874679375701888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 215us (2618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787833958.975484:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787833958.975634:0:14440:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787833958.975845:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b646e1a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1874679375701888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787833959.164601:0:14432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787833960.193411:0:14433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29438 lines, 29438 kept, 0 dropped, 0 bad.